Skip to content

perf[fsst]: like pushdown using a dfa#6935

Open
joseph-isaacs wants to merge 19 commits intodevelopfrom
ji/fsst-like-kernel
Open

perf[fsst]: like pushdown using a dfa#6935
joseph-isaacs wants to merge 19 commits intodevelopfrom
ji/fsst-like-kernel

Conversation

@joseph-isaacs
Copy link
Contributor

@joseph-isaacs joseph-isaacs commented Mar 13, 2026 •
edited
Loading

Fsst like execution without decompression.

This uses a DFA over the symbol table and the like expression.

Once this is proved out we could think about putting this in fsst-rs?

@joseph-isaacs
perf[fsst]: like pushdown using a dfa
0e3698d 
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@joseph-isaacs joseph-isaacs added the changelog/performance A performance improvement label Mar 13, 2026
@codspeed-hq
Copy link

codspeed-hq bot commented Mar 13, 2026 •
edited
Loading

Merging this PR will improve performance by ×4.3

⚡ 2 improved benchmarks
✅ 1000 untouched benchmarks
🆕 14 new benchmarks
⏩ 1522 skipped benchmarks1

Performance Changes

Mode Benchmark BASE HEAD Efficiency
🆕 Simulation fsst_contains[path] N/A 5.9 ms N/A
🆕 Simulation fsst_contains[email] N/A 5.4 ms N/A
🆕 Simulation fsst_contains[log] N/A 26.3 ms N/A
🆕 Simulation fsst_contains[urls] N/A 11.3 ms N/A
🆕 Simulation fsst_contains[rare] N/A 24.4 ms N/A
🆕 Simulation fsst_prefix[email] N/A 3.3 ms N/A
🆕 Simulation fsst_contains[json] N/A 14.8 ms N/A
🆕 Simulation fsst_prefix[path] N/A 3.4 ms N/A
🆕 Simulation fsst_contains[cb] N/A 16.4 ms N/A
🆕 Simulation fsst_prefix[cb] N/A 5.3 ms N/A
🆕 Simulation fsst_prefix[log] N/A 5.3 ms N/A
🆕 Simulation fsst_prefix[rare] N/A 5 ms N/A
🆕 Simulation fsst_prefix[urls] N/A 3.5 ms N/A
🆕 Simulation fsst_prefix[json] N/A 4.1 ms N/A
⚡ Simulation like_substr_low_match 38.1 ms 12.1 ms ×3.1
⚡ Simulation like_substr_high_match 39.2 ms 9.1 ms ×4.3

Comparing ji/fsst-like-kernel (b013dad) with develop (402d5ce)

Open in CodSpeed

Footnotes

  1. 1522 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports. ↩

@joseph-isaacs
clean up
53b7b3d 
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@joseph-isaacs
Merge remote-tracking branch 'origin/develop' into ji/fsst-like-kernel
0612dbe 
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@joseph-isaacs
clean up
e08fb69 
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@joseph-isaacs
clean up
0fd7acb 
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@joseph-isaacs
clean up
b0e94b8 
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@joseph-isaacs
clean up
7faf9f3 
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@joseph-isaacs
clean up
f1c6a02 
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@joseph-isaacs joseph-isaacs added the action/benchmark Trigger full benchmarks to run on this PR label Mar 18, 2026
@github-actions github-actions bot removed the action/benchmark Trigger full benchmarks to run on this PR label Mar 18, 2026
@github-actions
Copy link
Contributor

github-actions bot commented Mar 18, 2026 •
edited
Loading

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done 5881376 2 Explore Profiling Data
Previous Runs (4)
Status Commit Job Attempt Link
🟢 Done 5881376 1 Explore Profiling Data
🟢 Done 9d278dc 2 Explore Profiling Data
🟢 Done 9d278dc 1 Explore Profiling Data
🟢 Done f1c6a02 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions
Copy link
Contributor

github-actions bot commented Mar 18, 2026 •
edited
Loading

Benchmarks: PolarSignals Profiling

Vortex (geomean): 1.029x ➖

datafusion / vortex-file-compressed (1.029x ➖, 0↑ 1↓)
name PR 5881376 (ns) base 8efe1dc (ns) ratio (PR/base)
polarsignals_q00/datafusion:vortex-file-compressed 116309525 114161179 1.02
polarsignals_q01/datafusion:vortex-file-compressed 342269106 337473660 1.01
polarsignals_q02/datafusion:vortex-file-compressed 21622993 21400031 1.01
polarsignals_q03/datafusion:vortex-file-compressed 348196568 342260130 1.02
polarsignals_q04/datafusion:vortex-file-compressed 11879236 11796300 1.01
polarsignals_q05/datafusion:vortex-file-compressed 🚨 17002020 15329907 1.11
polarsignals_q06/datafusion:vortex-file-compressed 19822378 19618797 1.01
polarsignals_q07/datafusion:vortex-file-compressed 12613755 12058926 1.05
polarsignals_q08/datafusion:vortex-file-compressed 433488089 428175655 1.01
polarsignals_q09/datafusion:vortex-file-compressed 11298251 10781993 1.05

@github-actions
Copy link
Contributor

github-actions bot commented Mar 18, 2026 •
edited
Loading

Benchmarks: TPC-H SF=1 on NVME

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +2.4%
Vortex (geomean): 1.060x ➖
Parquet (geomean): 1.036x ➖
Shifts: Parquet (control) +3.6% · Median polish +5.1%

datafusion / vortex-file-compressed (1.058x ➖, 0↑ 2↓)
name PR 5881376 (ns) base 8efe1dc (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 53805446 53481592 1.01
tpch_q02/datafusion:vortex-file-compressed 53477372 50050710 1.07
tpch_q03/datafusion:vortex-file-compressed 29306921 27817138 1.05
tpch_q04/datafusion:vortex-file-compressed 20013753 18932571 1.06
tpch_q05/datafusion:vortex-file-compressed 82179027 74803461 1.10
tpch_q06/datafusion:vortex-file-compressed 10499318 9985911 1.05
tpch_q07/datafusion:vortex-file-compressed 🚨 97395735 87775885 1.11
tpch_q08/datafusion:vortex-file-compressed 68725255 65361675 1.05
tpch_q09/datafusion:vortex-file-compressed 89059618 85784270 1.04
tpch_q10/datafusion:vortex-file-compressed 82354814 76512074 1.08
tpch_q11/datafusion:vortex-file-compressed 19886381 19839592 1.00
tpch_q12/datafusion:vortex-file-compressed 36649744 34564976 1.06
tpch_q13/datafusion:vortex-file-compressed 28142617 27296727 1.03
tpch_q14/datafusion:vortex-file-compressed 29040056 27047693 1.07
tpch_q15/datafusion:vortex-file-compressed 27418878 24970326 1.10
tpch_q16/datafusion:vortex-file-compressed 🚨 36848451 33495415 1.10
tpch_q17/datafusion:vortex-file-compressed 83317913 77087283 1.08
tpch_q18/datafusion:vortex-file-compressed 108519081 104513541 1.04
tpch_q19/datafusion:vortex-file-compressed 36459940 35428219 1.03
tpch_q20/datafusion:vortex-file-compressed 53381110 49253702 1.08
tpch_q21/datafusion:vortex-file-compressed 98031074 95061992 1.03
tpch_q22/datafusion:vortex-file-compressed 15800253 15131037 1.04
datafusion / vortex-compact (1.061x ➖, 0↑ 1↓)
name PR 5881376 (ns) base 8efe1dc (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 66301471 60620243 1.09
tpch_q02/datafusion:vortex-compact 53062150 53078806 1.00
tpch_q03/datafusion:vortex-compact 33251747 32322107 1.03
tpch_q04/datafusion:vortex-compact 24694595 23094920 1.07
tpch_q05/datafusion:vortex-compact 86095136 83413154 1.03
tpch_q06/datafusion:vortex-compact 🚨 15579342 13400729 1.16
tpch_q07/datafusion:vortex-compact 101446975 94857421 1.07
tpch_q08/datafusion:vortex-compact 75136998 72323753 1.04
tpch_q09/datafusion:vortex-compact 95292317 91298723 1.04
tpch_q10/datafusion:vortex-compact 81989045 78105813 1.05
tpch_q11/datafusion:vortex-compact 22117929 20506881 1.08
tpch_q12/datafusion:vortex-compact 46047751 44449828 1.04
tpch_q13/datafusion:vortex-compact 38195964 36207840 1.05
tpch_q14/datafusion:vortex-compact 33273688 31217218 1.07
tpch_q15/datafusion:vortex-compact 34796511 32093449 1.08
tpch_q16/datafusion:vortex-compact 41795253 38550468 1.08
tpch_q17/datafusion:vortex-compact 85955366 79658887 1.08
tpch_q18/datafusion:vortex-compact 115653827 107237552 1.08
tpch_q19/datafusion:vortex-compact 47133409 44301830 1.06
tpch_q20/datafusion:vortex-compact 57398908 55739739 1.03
tpch_q21/datafusion:vortex-compact 112672159 106543208 1.06
tpch_q22/datafusion:vortex-compact 17060969 16335330 1.04
datafusion / parquet (1.048x ➖, 0↑ 1↓)
name PR 5881376 (ns) base 8efe1dc (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 148379505 138242270 1.07
tpch_q02/datafusion:parquet 85765410 82075848 1.04
tpch_q03/datafusion:parquet 89961860 86370868 1.04
tpch_q04/datafusion:parquet 56740951 53875496 1.05
tpch_q05/datafusion:parquet 164046166 163483250 1.00
tpch_q06/datafusion:parquet 47509944 47299169 1.00
tpch_q07/datafusion:parquet 189121206 182856013 1.03
tpch_q08/datafusion:parquet 170162488 158113604 1.08
tpch_q09/datafusion:parquet 214424755 215323073 1.00
tpch_q10/datafusion:parquet 200000193 187769870 1.07
tpch_q11/datafusion:parquet 64359045 60488659 1.06
tpch_q12/datafusion:parquet 121862135 123546879 0.99
tpch_q13/datafusion:parquet 210890615 196759730 1.07
tpch_q14/datafusion:parquet 83870673 80089771 1.05
tpch_q15/datafusion:parquet 71959035 67386050 1.07
tpch_q16/datafusion:parquet 58708996 54655245 1.07
tpch_q17/datafusion:parquet 🚨 196235459 169716217 1.16
tpch_q18/datafusion:parquet 241454541 229383726 1.05
tpch_q19/datafusion:parquet 99851246 103820957 0.96
tpch_q20/datafusion:parquet 127975906 117724669 1.09
tpch_q21/datafusion:parquet 193104170 186241082 1.04
tpch_q22/datafusion:parquet 41943989 39371503 1.07
datafusion / arrow (1.080x ➖, 1↑ 8↓)
name PR 5881376 (ns) base 8efe1dc (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 🚀 62387005 69490624 0.90
tpch_q02/datafusion:arrow 23034747 23288373 0.99
tpch_q03/datafusion:arrow 39046508 37664441 1.04
tpch_q04/datafusion:arrow 30985155 31090653 1.00
tpch_q05/datafusion:arrow 95612893 91635964 1.04
tpch_q06/datafusion:arrow 21915753 21330605 1.03
tpch_q07/datafusion:arrow 🚨 192345257 166417041 1.16
tpch_q08/datafusion:arrow 🚨 51742712 45866137 1.13
tpch_q09/datafusion:arrow 🚨 83458367 74882876 1.11
tpch_q10/datafusion:arrow 🚨 62611926 56443448 1.11
tpch_q11/datafusion:arrow 12492269 11591752 1.08
tpch_q12/datafusion:arrow 62433375 57191107 1.09
tpch_q13/datafusion:arrow 54035939 50243608 1.08
tpch_q14/datafusion:arrow 🚨 28752600 25825836 1.11
tpch_q15/datafusion:arrow 52165051 49863137 1.05
tpch_q16/datafusion:arrow 24922633 23611130 1.06
tpch_q17/datafusion:arrow 86621288 85802305 1.01
tpch_q18/datafusion:arrow 174555513 161805273 1.08
tpch_q19/datafusion:arrow 🚨 49090848 40656850 1.21
tpch_q20/datafusion:arrow 🚨 48153335 41313433 1.17
tpch_q21/datafusion:arrow 🚨 308486434 231421870 1.33
tpch_q22/datafusion:arrow 22785497 20993990 1.09
duckdb / vortex-file-compressed (1.071x ➖, 0↑ 8↓)
name PR 5881376 (ns) base 8efe1dc (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 32411943 33511655 0.97
tpch_q02/duckdb:vortex-file-compressed 29107138 28147748 1.03
tpch_q03/duckdb:vortex-file-compressed 31814350 30525823 1.04
tpch_q04/duckdb:vortex-file-compressed 🚨 31896113 28800604 1.11
tpch_q05/duckdb:vortex-file-compressed 🚨 37440006 33448026 1.12
tpch_q06/duckdb:vortex-file-compressed 🚨 11619988 10520795 1.10
tpch_q07/duckdb:vortex-file-compressed 39437812 36118642 1.09
tpch_q08/duckdb:vortex-file-compressed 41664506 41538107 1.00
tpch_q09/duckdb:vortex-file-compressed 84929322 83957896 1.01
tpch_q10/duckdb:vortex-file-compressed 🚨 40506787 36271905 1.12
tpch_q11/duckdb:vortex-file-compressed 17217307 16029753 1.07
tpch_q12/duckdb:vortex-file-compressed 🚨 25984992 23217556 1.12
tpch_q13/duckdb:vortex-file-compressed 40244651 37309484 1.08
tpch_q14/duckdb:vortex-file-compressed 🚨 23805171 21640659 1.10
tpch_q15/duckdb:vortex-file-compressed 16971644 15871989 1.07
tpch_q16/duckdb:vortex-file-compressed 31235167 29759789 1.05
tpch_q17/duckdb:vortex-file-compressed 26595808 25540154 1.04
tpch_q18/duckdb:vortex-file-compressed 50808610 47781561 1.06
tpch_q19/duckdb:vortex-file-compressed 35505302 32411168 1.10
tpch_q20/duckdb:vortex-file-compressed 🚨 37603942 34172483 1.10
tpch_q21/duckdb:vortex-file-compressed 🚨 113584598 101126292 1.12
tpch_q22/duckdb:vortex-file-compressed 19882861 18560283 1.07
duckdb / vortex-compact (1.051x ➖, 0↑ 3↓)
name PR 5881376 (ns) base 8efe1dc (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 41662029 40135706 1.04
tpch_q02/duckdb:vortex-compact 🚨 41115392 36738692 1.12
tpch_q03/duckdb:vortex-compact 33422170 33256815 1.00
tpch_q04/duckdb:vortex-compact 36149879 35401774 1.02
tpch_q05/duckdb:vortex-compact 39604529 37908804 1.04
tpch_q06/duckdb:vortex-compact 15279241 15182909 1.01
tpch_q07/duckdb:vortex-compact 45106913 41749701 1.08
tpch_q08/duckdb:vortex-compact 47128096 45074880 1.05
tpch_q09/duckdb:vortex-compact 96036785 89981178 1.07
tpch_q10/duckdb:vortex-compact 43442706 40448579 1.07
tpch_q11/duckdb:vortex-compact 🚨 22264706 19699427 1.13
tpch_q12/duckdb:vortex-compact 🚨 40239900 35904334 1.12
tpch_q13/duckdb:vortex-compact 49708400 47004332 1.06
tpch_q14/duckdb:vortex-compact 32295628 29472414 1.10
tpch_q15/duckdb:vortex-compact 20227233 19673283 1.03
tpch_q16/duckdb:vortex-compact 38082011 36397323 1.05
tpch_q17/duckdb:vortex-compact 31249180 30596685 1.02
tpch_q18/duckdb:vortex-compact 51803414 50403980 1.03
tpch_q19/duckdb:vortex-compact 39809546 37328227 1.07
tpch_q20/duckdb:vortex-compact 46242859 45567557 1.01
tpch_q21/duckdb:vortex-compact 112999535 110099789 1.03
tpch_q22/duckdb:vortex-compact 20548092 20479099 1.00
duckdb / parquet (1.024x ➖, 2↑ 3↓)
name PR 5881376 (ns) base 8efe1dc (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 82786744 76613317 1.08
tpch_q02/duckdb:parquet 39581974 39629091 1.00
tpch_q03/duckdb:parquet 70124013 68999793 1.02
tpch_q04/duckdb:parquet 🚨 54614649 48337642 1.13
tpch_q05/duckdb:parquet 68111446 67167116 1.01
tpch_q06/duckdb:parquet 20616220 21300817 0.97
tpch_q07/duckdb:parquet 73990478 67604848 1.09
tpch_q08/duckdb:parquet 80976871 87085230 0.93
tpch_q09/duckdb:parquet 154732154 155075043 1.00
tpch_q10/duckdb:parquet 142173260 136227829 1.04
tpch_q11/duckdb:parquet 22930006 23263354 0.99
tpch_q12/duckdb:parquet 🚀 45918129 56255805 0.82
tpch_q13/duckdb:parquet 🚨 286757018 259608842 1.10
tpch_q14/duckdb:parquet 50419066 48831629 1.03
tpch_q15/duckdb:parquet 🚀 25652998 32686795 0.78
tpch_q16/duckdb:parquet 59538202 54530618 1.09
tpch_q17/duckdb:parquet 60200746 54992794 1.09
tpch_q18/duckdb:parquet 124285555 117449728 1.06
tpch_q19/duckdb:parquet 90488804 86067232 1.05
tpch_q20/duckdb:parquet 65965643 62327642 1.06
tpch_q21/duckdb:parquet 🚨 198099731 161224862 1.23
tpch_q22/duckdb:parquet 54578321 52372787 1.04
duckdb / duckdb (1.044x ➖, 0↑ 1↓)
name PR 5881376 (ns) base 8efe1dc (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 16384193 16543750 0.99
tpch_q02/duckdb:duckdb 12358332 12084645 1.02
tpch_q03/duckdb:duckdb 19264100 19563130 0.98
tpch_q04/duckdb:duckdb 20167501 18372403 1.10
tpch_q05/duckdb:duckdb 20013934 19321918 1.04
tpch_q06/duckdb:duckdb 🚨 6032887 5437366 1.11
tpch_q07/duckdb:duckdb 23330894 22238014 1.05
tpch_q08/duckdb:duckdb 21340350 20610153 1.04
tpch_q09/duckdb:duckdb 56180878 54260673 1.04
tpch_q10/duckdb:duckdb 46691362 42549536 1.10
tpch_q11/duckdb:duckdb 6251181 5762030 1.08
tpch_q12/duckdb:duckdb 14234553 13441672 1.06
tpch_q13/duckdb:duckdb 40963347 37372084 1.10
tpch_q14/duckdb:duckdb 18347089 16767945 1.09
tpch_q15/duckdb:duckdb 11933685 11848099 1.01
tpch_q16/duckdb:duckdb 23634894 22950032 1.03
tpch_q17/duckdb:duckdb 14024770 13507378 1.04
tpch_q18/duckdb:duckdb 38397137 37776800 1.02
tpch_q19/duckdb:duckdb 27724101 26886835 1.03
tpch_q20/duckdb:duckdb 23984399 23219946 1.03
tpch_q21/duckdb:duckdb 57634562 56236623 1.02
tpch_q22/duckdb:duckdb 24851819 24518744 1.01
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow -10.2% +7.7% -16.6% +25.7% ➖ noise
1 datafusion:vortex-compact +9.4% +7.7% +1.6% +23.3% ➖ noise
1 datafusion:vortex-file-compressed +0.6% +7.7% -6.6% +23.0% ➖ noise
1 duckdb:duckdb -1.0% +7.7% -8.0% +23.0% ➖ noise
1 duckdb:vortex-compact +3.8% +7.7% -3.6% +23.5% ➖ noise
1 duckdb:vortex-file-compressed -3.3% +7.7% -10.2% +23.2% ➖ noise
2 datafusion:arrow -1.1% +2.2% -3.2% +15.9% ➖ noise
2 datafusion:vortex-compact -0.0% +2.2% -2.1% +15.9% ➖ noise
2 datafusion:vortex-file-compressed +6.8% +2.2% +4.6% +15.9% ➖ noise
2 duckdb:duckdb +2.3% +2.2% +0.1% +15.9% ➖ noise
2 duckdb:vortex-compact +11.9% +2.2% +9.5% +15.9% ➖ noise
2 duckdb:vortex-file-compressed +3.4% +2.2% +1.2% +15.9% ➖ noise
3 datafusion:arrow +3.7% +2.9% +0.8% +15.9% ➖ noise
3 datafusion:vortex-compact +2.9% +2.9% -0.0% +15.9% ➖ noise
3 datafusion:vortex-file-compressed +5.4% +2.9% +2.4% +15.9% ➖ noise
3 duckdb:duckdb -1.5% +2.9% -4.3% +17.1% ➖ noise
3 duckdb:vortex-compact +0.5% +2.9% -2.3% +15.9% ➖ noise
3 duckdb:vortex-file-compressed +4.2% +2.9% +1.3% +15.9% ➖ noise
4 datafusion:arrow -0.3% +9.1% -8.6% +15.9% ➖ noise
4 datafusion:vortex-compact +6.9% +9.1% -2.0% +15.9% ➖ noise
4 datafusion:vortex-file-compressed +5.7% +9.1% -3.1% +15.9% ➖ noise
4 duckdb:duckdb +9.8% +9.1% +0.6% +16.3% ➖ noise
4 duckdb:vortex-compact +2.1% +9.1% -6.4% +15.9% ➖ noise
4 duckdb:vortex-file-compressed +10.7% +9.1% +1.5% +15.9% ➖ noise
5 datafusion:arrow +4.3% +0.9% +3.4% +15.9% ➖ noise
5 datafusion:vortex-compact +3.2% +0.9% +2.3% +15.9% ➖ noise
5 datafusion:vortex-file-compressed +9.9% +0.9% +8.9% +15.9% ➖ noise
5 duckdb:duckdb +3.6% +0.9% +2.7% +15.9% ➖ noise
5 duckdb:vortex-compact +4.5% +0.9% +3.6% +15.9% ➖ noise
5 duckdb:vortex-file-compressed +11.9% +0.9% +11.0% +15.9% ➖ noise
6 datafusion:arrow +2.7% -1.4% +4.2% +19.1% ➖ noise
6 datafusion:vortex-compact +16.3% -1.4% +17.9% +18.5% ➖ noise
6 datafusion:vortex-file-compressed +5.1% -1.4% +6.6% +19.7% ➖ noise
6 duckdb:duckdb +11.0% -1.4% +12.5% +22.8% ➖ noise
6 duckdb:vortex-compact +0.6% -1.4% +2.1% +18.7% ➖ noise
6 duckdb:vortex-file-compressed +10.4% -1.4% +12.0% +17.6% ➖ noise
7 datafusion:arrow +15.6% +6.4% +8.6% +15.9% ➖ noise
7 datafusion:vortex-compact +6.9% +6.4% +0.5% +15.9% ➖ noise
7 datafusion:vortex-file-compressed +11.0% +6.4% +4.3% +15.9% ➖ noise
7 duckdb:duckdb +4.9% +6.4% -1.4% +15.9% ➖ noise
7 duckdb:vortex-compact +8.0% +6.4% +1.5% +15.9% ➖ noise
7 duckdb:vortex-file-compressed +9.2% +6.4% +2.6% +15.9% ➖ noise
8 datafusion:arrow +12.8% +0.0% +12.8% +15.9% ➖ noise
8 datafusion:vortex-compact +3.9% +0.0% +3.9% +15.9% ➖ noise
8 datafusion:vortex-file-compressed +5.1% +0.0% +5.1% +15.9% ➖ noise
8 duckdb:duckdb +3.5% +0.0% +3.5% +15.9% ➖ noise
8 duckdb:vortex-compact +4.6% +0.0% +4.5% +15.9% ➖ noise
8 duckdb:vortex-file-compressed +0.3% +0.0% +0.3% +15.9% ➖ noise
9 datafusion:arrow +11.5% -0.3% +11.8% +15.9% ➖ noise
9 datafusion:vortex-compact +4.4% -0.3% +4.7% +15.9% ➖ noise
9 datafusion:vortex-file-compressed +3.8% -0.3% +4.2% +15.9% ➖ noise
9 duckdb:duckdb +3.5% -0.3% +3.9% +15.9% ➖ noise
9 duckdb:vortex-compact +6.7% -0.3% +7.1% +15.9% ➖ noise
9 duckdb:vortex-file-compressed +1.2% -0.3% +1.5% +15.9% ➖ noise
10 datafusion:arrow +10.9% +5.4% +5.2% +15.9% ➖ noise
10 datafusion:vortex-compact +5.0% +5.4% -0.4% +15.9% ➖ noise
10 datafusion:vortex-file-compressed +7.6% +5.4% +2.1% +15.9% ➖ noise
10 duckdb:duckdb +9.7% +5.4% +4.1% +19.4% ➖ noise
10 duckdb:vortex-compact +7.4% +5.4% +1.9% +15.9% ➖ noise
10 duckdb:vortex-file-compressed +11.7% +5.4% +5.9% +15.9% ➖ noise
11 datafusion:arrow +7.8% +2.4% +5.2% +15.9% ➖ noise
11 datafusion:vortex-compact +7.9% +2.4% +5.3% +15.9% ➖ noise
11 datafusion:vortex-file-compressed +0.2% +2.4% -2.1% +18.1% ➖ noise
11 duckdb:duckdb +8.5% +2.4% +5.9% +15.9% ➖ noise
11 duckdb:vortex-compact +13.0% +2.4% +10.4% +17.1% ➖ noise
11 duckdb:vortex-file-compressed +7.4% +2.4% +4.9% +15.9% ➖ noise
12 datafusion:arrow +9.2% -10.3% +21.7% +15.9% 🚨 regression
12 datafusion:vortex-compact +3.6% -10.3% +15.5% +15.9% ➖ noise
12 datafusion:vortex-file-compressed +6.0% -10.3% +18.2% +15.9% 🚨 regression
12 duckdb:duckdb +5.9% -10.3% +18.0% +15.9% 🚨 regression
12 duckdb:vortex-compact +12.1% -10.3% +24.9% +15.9% 🚨 regression
12 duckdb:vortex-file-compressed +11.9% -10.3% +24.7% +15.9% 🚨 regression
13 datafusion:arrow +7.5% +8.8% -1.2% +15.9% ➖ noise
13 datafusion:vortex-compact +5.5% +8.8% -3.0% +15.9% ➖ noise
13 datafusion:vortex-file-compressed +3.1% +8.8% -5.2% +15.9% ➖ noise
13 duckdb:duckdb +9.6% +8.8% +0.7% +15.9% ➖ noise
13 duckdb:vortex-compact +5.8% +8.8% -2.8% +15.9% ➖ noise
13 duckdb:vortex-file-compressed +7.9% +8.8% -0.9% +15.9% ➖ noise
14 datafusion:arrow +11.3% +4.0% +7.1% +15.9% ➖ noise
14 datafusion:vortex-compact +6.6% +4.0% +2.5% +15.9% ➖ noise
14 datafusion:vortex-file-compressed +7.4% +4.0% +3.3% +15.9% ➖ noise
14 duckdb:duckdb +9.4% +4.0% +5.2% +20.1% ➖ noise
14 duckdb:vortex-compact +9.6% +4.0% +5.4% +15.9% ➖ noise
14 duckdb:vortex-file-compressed +10.0% +4.0% +5.8% +15.9% ➖ noise
15 datafusion:arrow +4.6% -8.5% +14.3% +17.2% ➖ noise
15 datafusion:vortex-compact +8.4% -8.5% +18.4% +17.7% 🚨 regression
15 datafusion:vortex-file-compressed +9.8% -8.5% +19.9% +18.9% 🚨 regression
15 duckdb:duckdb +0.7% -8.5% +10.0% +21.4% ➖ noise
15 duckdb:vortex-compact +2.8% -8.5% +12.3% +16.5% ➖ noise
15 duckdb:vortex-file-compressed +6.9% -8.5% +16.8% +16.6% 🚨 regression
16 datafusion:arrow +5.6% +8.3% -2.5% +15.9% ➖ noise
16 datafusion:vortex-compact +8.4% +8.3% +0.1% +15.9% ➖ noise
16 datafusion:vortex-file-compressed +10.0% +8.3% +1.6% +15.9% ➖ noise
16 duckdb:duckdb +3.0% +8.3% -4.9% +15.9% ➖ noise
16 duckdb:vortex-compact +4.6% +8.3% -3.4% +15.9% ➖ noise
16 duckdb:vortex-file-compressed +5.0% +8.3% -3.1% +15.9% ➖ noise
17 datafusion:arrow +1.0% +12.5% -10.3% +15.9% ➖ noise
17 datafusion:vortex-compact +7.9% +12.5% -4.1% +15.9% ➖ noise
17 datafusion:vortex-file-compressed +8.1% +12.5% -3.9% +15.9% ➖ noise
17 duckdb:duckdb +3.8% +12.5% -7.7% +15.9% ➖ noise
17 duckdb:vortex-compact +2.1% +12.5% -9.2% +15.9% ➖ noise
17 duckdb:vortex-file-compressed +4.1% +12.5% -7.4% +15.9% ➖ noise
18 datafusion:arrow +7.9% +5.5% +2.2% +15.9% ➖ noise
18 datafusion:vortex-compact +7.8% +5.5% +2.2% +15.9% ➖ noise
18 datafusion:vortex-file-compressed +3.8% +5.5% -1.6% +15.9% ➖ noise
18 duckdb:duckdb +1.6% +5.5% -3.7% +15.9% ➖ noise
18 duckdb:vortex-compact +2.8% +5.5% -2.6% +15.9% ➖ noise
18 duckdb:vortex-file-compressed +6.3% +5.5% +0.8% +15.9% ➖ noise
19 datafusion:arrow +20.7% +0.6% +20.1% +16.2% 🚨 regression
19 datafusion:vortex-compact +6.4% +0.6% +5.8% +20.5% ➖ noise
19 datafusion:vortex-file-compressed +2.9% +0.6% +2.3% +18.9% ➖ noise
19 duckdb:duckdb +3.1% +0.6% +2.5% +21.0% ➖ noise
19 duckdb:vortex-compact +6.6% +0.6% +6.1% +15.9% ➖ noise
19 duckdb:vortex-file-compressed +9.5% +0.6% +8.9% +15.9% ➖ noise
20 datafusion:arrow +16.6% +7.3% +8.7% +15.9% ➖ noise
20 datafusion:vortex-compact +3.0% +7.3% -4.0% +15.9% ➖ noise
20 datafusion:vortex-file-compressed +8.4% +7.3% +1.0% +16.0% ➖ noise
20 duckdb:duckdb +3.3% +7.3% -3.7% +15.9% ➖ noise
20 duckdb:vortex-compact +1.5% +7.3% -5.4% +15.9% ➖ noise
20 duckdb:vortex-file-compressed +10.0% +7.3% +2.6% +19.0% ➖ noise
21 datafusion:arrow +33.3% +12.9% +18.1% +15.9% 🚨 regression
21 datafusion:vortex-compact +5.8% +12.9% -6.3% +15.9% ➖ noise
21 datafusion:vortex-file-compressed +3.1% +12.9% -8.6% +15.9% ➖ noise
21 duckdb:duckdb +2.5% +12.9% -9.2% +15.9% ➖ noise
21 duckdb:vortex-compact +2.6% +12.9% -9.1% +15.9% ➖ noise
21 duckdb:vortex-file-compressed +12.3% +12.9% -0.5% +15.9% ➖ noise
22 datafusion:arrow +8.5% +5.4% +3.0% +25.5% ➖ noise
22 datafusion:vortex-compact +4.4% +5.4% -0.9% +15.9% ➖ noise
22 datafusion:vortex-file-compressed +4.4% +5.4% -0.9% +15.9% ➖ noise
22 duckdb:duckdb +1.4% +5.4% -3.8% +15.9% ➖ noise
22 duckdb:vortex-compact +0.3% +5.4% -4.8% +15.9% ➖ noise
22 duckdb:vortex-file-compressed +7.1% +5.4% +1.7% +15.9% ➖ noise

@github-actions
Copy link
Contributor

github-actions bot commented Mar 18, 2026 •
edited
Loading

Benchmarks: FineWeb NVMe

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +7.1%
Vortex (geomean): 1.062x ➖
Parquet (geomean): 0.992x ➖
Shifts: Parquet (control) -0.8% · Median polish -0.4%

datafusion / vortex-file-compressed (1.145x ❌, 0↑ 5↓)
name PR 5881376 (ns) base 8efe1dc (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 4485811 4612190 0.97
fineweb_q01/datafusion:vortex-file-compressed 🚨 29531033 24069752 1.23
fineweb_q02/datafusion:vortex-file-compressed 🚨 30578918 25724811 1.19
fineweb_q03/datafusion:vortex-file-compressed 79498978 75179896 1.06
fineweb_q04/datafusion:vortex-file-compressed 🚨 274865620 201953057 1.36
fineweb_q05/datafusion:vortex-file-compressed 🚨 251468884 185547695 1.36
fineweb_q06/datafusion:vortex-file-compressed 71612120 69076673 1.04
fineweb_q07/datafusion:vortex-file-compressed 🚨 72763605 64387251 1.13
fineweb_q08/datafusion:vortex-file-compressed 25111075 24121226 1.04
datafusion / vortex-compact (1.010x ➖, 0↑ 0↓)
name PR 5881376 (ns) base 8efe1dc (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 4099973 4198383 0.98
fineweb_q01/datafusion:vortex-compact 163526073 162662211 1.01
fineweb_q02/datafusion:vortex-compact 164754882 164431318 1.00
fineweb_q03/datafusion:vortex-compact 1438604161 1449071498 0.99
fineweb_q04/datafusion:vortex-compact 1568403246 1543930083 1.02
fineweb_q05/datafusion:vortex-compact 1231401811 1223589116 1.01
fineweb_q06/datafusion:vortex-compact 692252528 692484784 1.00
fineweb_q07/datafusion:vortex-compact 728480903 728590320 1.00
fineweb_q08/datafusion:vortex-compact 23805436 21756625 1.09
datafusion / parquet (0.991x ➖, 0↑ 0↓)
name PR 5881376 (ns) base 8efe1dc (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 6378704 6115106 1.04
fineweb_q01/datafusion:parquet 268094642 273564264 0.98
fineweb_q02/datafusion:parquet 269741094 276369174 0.98
fineweb_q03/datafusion:parquet 267288334 272199647 0.98
fineweb_q04/datafusion:parquet 287854986 286575704 1.00
fineweb_q05/datafusion:parquet 283984020 284468254 1.00
fineweb_q06/datafusion:parquet 274467603 285610972 0.96
fineweb_q07/datafusion:parquet 270452777 270600669 1.00
fineweb_q08/datafusion:parquet 262254039 268250155 0.98
duckdb / vortex-file-compressed (1.111x ❌, 0↑ 4↓)
name PR 5881376 (ns) base 8efe1dc (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 3272010 3283228 1.00
fineweb_q01/duckdb:vortex-file-compressed 27808337 29263899 0.95
fineweb_q02/duckdb:vortex-file-compressed 26480579 26597556 1.00
fineweb_q03/duckdb:vortex-file-compressed 🚨 152531823 129378177 1.18
fineweb_q04/duckdb:vortex-file-compressed 🚨 245425812 195241188 1.26
fineweb_q05/duckdb:vortex-file-compressed 🚨 239417265 165264920 1.45
fineweb_q06/duckdb:vortex-file-compressed 🚨 72889173 66032672 1.10
fineweb_q07/duckdb:vortex-file-compressed 72001255 65662920 1.10
fineweb_q08/duckdb:vortex-file-compressed 26386240 24985609 1.06
duckdb / vortex-compact (0.991x ➖, 0↑ 0↓)
name PR 5881376 (ns) base 8efe1dc (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 3948327 3813773 1.04
fineweb_q01/duckdb:vortex-compact 95094491 101627571 0.94
fineweb_q02/duckdb:vortex-compact 117212174 113995758 1.03
fineweb_q03/duckdb:vortex-compact 871699152 864133661 1.01
fineweb_q04/duckdb:vortex-compact 902073479 900981424 1.00
fineweb_q05/duckdb:vortex-compact 812059372 808061846 1.00
fineweb_q06/duckdb:vortex-compact 461013266 464287230 0.99
fineweb_q07/duckdb:vortex-compact 476859270 475729761 1.00
fineweb_q08/duckdb:vortex-compact 21698123 23619607 0.92
duckdb / parquet (0.992x ➖, 0↑ 0↓)
name PR 5881376 (ns) base 8efe1dc (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 34459975 36870964 0.93
fineweb_q01/duckdb:parquet 92062583 93625400 0.98
fineweb_q02/duckdb:parquet 94378146 95529280 0.99
fineweb_q03/duckdb:parquet 305859389 309149320 0.99
fineweb_q04/duckdb:parquet 437259565 436514097 1.00
fineweb_q05/duckdb:parquet 407851271 409255150 1.00
fineweb_q06/duckdb:parquet 197926090 197083514 1.00
fineweb_q07/duckdb:parquet 209671177 208261067 1.01
fineweb_q08/duckdb:parquet 58079293 56519859 1.03
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact -2.3% -1.3% -1.1% +51.6% ➖ noise
0 datafusion:vortex-file-compressed -2.7% -1.3% -1.5% +96.4% ➖ noise
0 duckdb:vortex-compact +3.5% -1.3% +4.9% +38.4% ➖ noise
0 duckdb:vortex-file-compressed -0.3% -1.3% +0.9% +49.7% ➖ noise
1 datafusion:vortex-compact +0.5% -1.8% +2.4% +12.1% ➖ noise
1 datafusion:vortex-file-compressed +22.7% -1.8% +25.0% +24.2% 🚨 regression
1 duckdb:vortex-compact -6.4% -1.8% -4.7% +16.0% ➖ noise
1 duckdb:vortex-file-compressed -5.0% -1.8% -3.2% +44.8% ➖ noise
2 datafusion:vortex-compact +0.2% -1.8% +2.0% +10.0% ➖ noise
2 datafusion:vortex-file-compressed +18.9% -1.8% +21.1% +14.4% 🚨 regression
2 duckdb:vortex-compact +2.8% -1.8% +4.7% +15.6% ➖ noise
2 duckdb:vortex-file-compressed -0.4% -1.8% +1.4% +10.0% ➖ noise
3 datafusion:vortex-compact -0.7% -1.4% +0.7% +10.0% ➖ noise
3 datafusion:vortex-file-compressed +5.7% -1.4% +7.3% +37.0% ➖ noise
3 duckdb:vortex-compact +0.9% -1.4% +2.3% +10.0% ➖ noise
3 duckdb:vortex-file-compressed +17.9% -1.4% +19.6% +26.7% ➖ noise
4 datafusion:vortex-compact +1.6% +0.3% +1.3% +10.0% ➖ noise
4 datafusion:vortex-file-compressed +36.1% +0.3% +35.7% +10.0% 🚨 regression
4 duckdb:vortex-compact +0.1% +0.3% -0.2% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +25.7% +0.3% +25.3% +10.0% 🚨 regression
5 datafusion:vortex-compact +0.6% -0.3% +0.9% +10.0% ➖ noise
5 datafusion:vortex-file-compressed +35.5% -0.3% +35.9% +10.0% 🚨 regression
5 duckdb:vortex-compact +0.5% -0.3% +0.8% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +44.9% -0.3% +45.2% +10.0% 🚨 regression
6 datafusion:vortex-compact -0.0% -1.8% +1.8% +10.0% ➖ noise
6 datafusion:vortex-file-compressed +3.7% -1.8% +5.5% +16.1% ➖ noise
6 duckdb:vortex-compact -0.7% -1.8% +1.1% +10.0% ➖ noise
6 duckdb:vortex-file-compressed +10.4% -1.8% +12.4% +12.5% ➖ noise
7 datafusion:vortex-compact -0.0% +0.3% -0.3% +10.0% ➖ noise
7 datafusion:vortex-file-compressed +13.0% +0.3% +12.7% +14.4% ➖ noise
7 duckdb:vortex-compact +0.2% +0.3% -0.1% +10.0% ➖ noise
7 duckdb:vortex-file-compressed +9.7% +0.3% +9.3% +12.9% ➖ noise
8 datafusion:vortex-compact +9.4% +0.2% +9.2% +21.6% ➖ noise
8 datafusion:vortex-file-compressed +4.1% +0.2% +3.9% +23.2% ➖ noise
8 duckdb:vortex-compact -8.1% +0.2% -8.3% +15.5% ➖ noise
8 duckdb:vortex-file-compressed +5.6% +0.2% +5.4% +24.0% ➖ noise

@github-actions
Copy link
Contributor

github-actions bot commented Mar 18, 2026 •
edited
Loading

Benchmarks: TPC-DS SF=1 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.5%
Vortex (geomean): 0.958x ➖
Parquet (geomean): 0.968x ➖
Shifts: Parquet (control) -3.2% · Median polish -3.6%

datafusion / vortex-file-compressed (0.953x ➖, 5↑ 0↓)
name PR 5881376 (ns) base 8efe1dc (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-file-compressed 26651291 28896465 0.92
tpcds_q02/datafusion:vortex-file-compressed 78563664 76135123 1.03
tpcds_q03/datafusion:vortex-file-compressed 27353010 28877888 0.95
tpcds_q04/datafusion:vortex-file-compressed 375690521 401537673 0.94
tpcds_q05/datafusion:vortex-file-compressed 74521579 75655774 0.99
tpcds_q06/datafusion:vortex-file-compressed 73340629 76694706 0.96
tpcds_q07/datafusion:vortex-file-compressed 74657397 75848493 0.98
tpcds_q08/datafusion:vortex-file-compressed 39029729 38840288 1.00
tpcds_q09/datafusion:vortex-file-compressed 45985435 48881905 0.94
tpcds_q10/datafusion:vortex-file-compressed 49120960 49007145 1.00
tpcds_q11/datafusion:vortex-file-compressed 231258366 239586487 0.97
tpcds_q12/datafusion:vortex-file-compressed 35559044 35599480 1.00
tpcds_q13/datafusion:vortex-file-compressed 76244884 80046675 0.95
tpcds_q14/datafusion:vortex-file-compressed 207762328 221358599 0.94
tpcds_q15/datafusion:vortex-file-compressed 47136932 50822488 0.93
tpcds_q16/datafusion:vortex-file-compressed 28677015 31658533 0.91
tpcds_q17/datafusion:vortex-file-compressed 107152521 112388390 0.95
tpcds_q18/datafusion:vortex-file-compressed 99299486 102606191 0.97
tpcds_q19/datafusion:vortex-file-compressed 45212251 49041351 0.92
tpcds_q20/datafusion:vortex-file-compressed 39386727 42203454 0.93
tpcds_q21/datafusion:vortex-file-compressed 173895311 176573317 0.98
tpcds_q22/datafusion:vortex-file-compressed 69363856 72518633 0.96
tpcds_q23/datafusion:vortex-file-compressed 187777902 195550134 0.96
tpcds_q24/datafusion:vortex-file-compressed 172738646 176720670 0.98
tpcds_q25/datafusion:vortex-file-compressed 109170045 113071364 0.97
tpcds_q26/datafusion:vortex-file-compressed 60325070 62558282 0.96
tpcds_q27/datafusion:vortex-file-compressed 158937986 171769934 0.93
tpcds_q28/datafusion:vortex-file-compressed 50010281 52148738 0.96
tpcds_q29/datafusion:vortex-file-compressed 110620747 109914565 1.01
tpcds_q30/datafusion:vortex-file-compressed 29774956 30332171 0.98
tpcds_q31/datafusion:vortex-file-compressed 173941287 182663496 0.95
tpcds_q32/datafusion:vortex-file-compressed 🚀 22638851 25677822 0.88
tpcds_q33/datafusion:vortex-file-compressed 37030938 39967593 0.93
tpcds_q34/datafusion:vortex-file-compressed 36571524 38774996 0.94
tpcds_q35/datafusion:vortex-file-compressed 60795945 62640824 0.97
tpcds_q36/datafusion:vortex-file-compressed 104019890 106553048 0.98
tpcds_q37/datafusion:vortex-file-compressed 37963831 36085667 1.05
tpcds_q38/datafusion:vortex-file-compressed 84529955 87475716 0.97
tpcds_q39/datafusion:vortex-file-compressed 🚀 188204754 211227583 0.89
tpcds_q40/datafusion:vortex-file-compressed 56778323 60562137 0.94
tpcds_q41/datafusion:vortex-file-compressed 🚀 13588382 16313474 0.83
tpcds_q42/datafusion:vortex-file-compressed 29593836 32048083 0.92
tpcds_q43/datafusion:vortex-file-compressed 48600328 51547642 0.94
tpcds_q44/datafusion:vortex-file-compressed 42838681 43849242 0.98
tpcds_q45/datafusion:vortex-file-compressed 48103275 49897399 0.96
tpcds_q46/datafusion:vortex-file-compressed 63366302 68123442 0.93
tpcds_q47/datafusion:vortex-file-compressed 268144774 283413187 0.95
tpcds_q48/datafusion:vortex-file-compressed 66393062 69443550 0.96
tpcds_q49/datafusion:vortex-file-compressed 67002306 74327156 0.90
tpcds_q50/datafusion:vortex-file-compressed 72272098 74948182 0.96
tpcds_q51/datafusion:vortex-file-compressed 98625174 100212908 0.98
tpcds_q52/datafusion:vortex-file-compressed 30268601 30306406 1.00
tpcds_q53/datafusion:vortex-file-compressed 30355714 31229880 0.97
tpcds_q54/datafusion:vortex-file-compressed 47949465 51095115 0.94
tpcds_q55/datafusion:vortex-file-compressed 30298423 31443197 0.96
tpcds_q56/datafusion:vortex-file-compressed 46506526 46634282 1.00
tpcds_q57/datafusion:vortex-file-compressed 173223247 187131701 0.93
tpcds_q58/datafusion:vortex-file-compressed 107305582 114516187 0.94
tpcds_q59/datafusion:vortex-file-compressed 92980655 96975125 0.96
tpcds_q60/datafusion:vortex-file-compressed 44836256 45324230 0.99
tpcds_q61/datafusion:vortex-file-compressed 57920021 57976084 1.00
tpcds_q62/datafusion:vortex-file-compressed 43343354 45995977 0.94
tpcds_q63/datafusion:vortex-file-compressed 29380305 29796314 0.99
tpcds_q64/datafusion:vortex-file-compressed 687489463 734694130 0.94
tpcds_q65/datafusion:vortex-file-compressed 51598318 52285534 0.99
tpcds_q66/datafusion:vortex-file-compressed 101910473 105303020 0.97
tpcds_q67/datafusion:vortex-file-compressed 139709651 146111038 0.96
tpcds_q68/datafusion:vortex-file-compressed 65011501 65566917 0.99
tpcds_q69/datafusion:vortex-file-compressed 44611786 46588533 0.96
tpcds_q70/datafusion:vortex-file-compressed 127537231 131664617 0.97
tpcds_q71/datafusion:vortex-file-compressed 30018897 30717885 0.98
tpcds_q72/datafusion:vortex-file-compressed 3290608214 3585664853 0.92
tpcds_q73/datafusion:vortex-file-compressed 39328844 41163581 0.96
tpcds_q74/datafusion:vortex-file-compressed 161911066 170441790 0.95
tpcds_q75/datafusion:vortex-file-compressed 129047472 138526778 0.93
tpcds_q76/datafusion:vortex-file-compressed 63655252 63887706 1.00
tpcds_q77/datafusion:vortex-file-compressed 53942262 57342967 0.94
tpcds_q78/datafusion:vortex-file-compressed 174749909 185657259 0.94
tpcds_q79/datafusion:vortex-file-compressed 43356277 44889026 0.97
tpcds_q80/datafusion:vortex-file-compressed 121198094 125933401 0.96
tpcds_q81/datafusion:vortex-file-compressed 🚀 34705534 39178489 0.89
tpcds_q82/datafusion:vortex-file-compressed 38482179 41422030 0.93
tpcds_q83/datafusion:vortex-file-compressed 65615055 67158567 0.98
tpcds_q84/datafusion:vortex-file-compressed 15041200 15937588 0.94
tpcds_q85/datafusion:vortex-file-compressed 134322623 133873082 1.00
tpcds_q86/datafusion:vortex-file-compressed 30108098 31424073 0.96
tpcds_q87/datafusion:vortex-file-compressed 87564113 88650933 0.99
tpcds_q88/datafusion:vortex-file-compressed 80231663 83211575 0.96
tpcds_q89/datafusion:vortex-file-compressed 54140815 57734941 0.94
tpcds_q90/datafusion:vortex-file-compressed 16634461 17841173 0.93
tpcds_q91/datafusion:vortex-file-compressed 26139962 27774208 0.94
tpcds_q92/datafusion:vortex-file-compressed 18346043 20214809 0.91
tpcds_q93/datafusion:vortex-file-compressed 37341766 38380692 0.97
tpcds_q94/datafusion:vortex-file-compressed 25005085 27122649 0.92
tpcds_q95/datafusion:vortex-file-compressed 87202439 93766128 0.93
tpcds_q96/datafusion:vortex-file-compressed 14923049 15832510 0.94
tpcds_q97/datafusion:vortex-file-compressed 🚀 30436182 34896948 0.87
tpcds_q98/datafusion:vortex-file-compressed 48383688 51487994 0.94
tpcds_q99/datafusion:vortex-file-compressed 58897276 65038798 0.91
datafusion / vortex-compact (0.956x ➖, 2↑ 0↓)
name PR 5881376 (ns) base 8efe1dc (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-compact 33989497 36033509 0.94
tpcds_q02/datafusion:vortex-compact 82705743 83580959 0.99
tpcds_q03/datafusion:vortex-compact 33243531 33060862 1.01
tpcds_q04/datafusion:vortex-compact 423756341 438560698 0.97
tpcds_q05/datafusion:vortex-compact 81389408 84244752 0.97
tpcds_q06/datafusion:vortex-compact 78533568 84208196 0.93
tpcds_q07/datafusion:vortex-compact 91086552 93421578 0.98
tpcds_q08/datafusion:vortex-compact 49080274 49110454 1.00
tpcds_q09/datafusion:vortex-compact 95680912 98089004 0.98
tpcds_q10/datafusion:vortex-compact 64742801 69162491 0.94
tpcds_q11/datafusion:vortex-compact 253109237 259663806 0.97
tpcds_q12/datafusion:vortex-compact 35710073 39453012 0.91
tpcds_q13/datafusion:vortex-compact 138933242 146401101 0.95
tpcds_q14/datafusion:vortex-compact 261881366 280424049 0.93
tpcds_q15/datafusion:vortex-compact 52868563 55505322 0.95
tpcds_q16/datafusion:vortex-compact 40531903 41222917 0.98
tpcds_q17/datafusion:vortex-compact 123566777 130482807 0.95
tpcds_q18/datafusion:vortex-compact 115148749 120094084 0.96
tpcds_q19/datafusion:vortex-compact 59409725 64477257 0.92
tpcds_q20/datafusion:vortex-compact 44174573 45817219 0.96
tpcds_q21/datafusion:vortex-compact 173411562 183711190 0.94
tpcds_q22/datafusion:vortex-compact 79166153 81150453 0.98
tpcds_q23/datafusion:vortex-compact 233392982 230174416 1.01
tpcds_q24/datafusion:vortex-compact 210341912 223260756 0.94
tpcds_q25/datafusion:vortex-compact 129696630 129863817 1.00
tpcds_q26/datafusion:vortex-compact 69479966 72659134 0.96
tpcds_q27/datafusion:vortex-compact 206818078 213235397 0.97
tpcds_q28/datafusion:vortex-compact 100713386 106037051 0.95
tpcds_q29/datafusion:vortex-compact 129403288 134613032 0.96
tpcds_q30/datafusion:vortex-compact 32672082 34433051 0.95
tpcds_q31/datafusion:vortex-compact 208533325 216092824 0.97
tpcds_q32/datafusion:vortex-compact 28200289 29988528 0.94
tpcds_q33/datafusion:vortex-compact 50501426 55199143 0.91
tpcds_q34/datafusion:vortex-compact 57376136 58534709 0.98
tpcds_q35/datafusion:vortex-compact 74026018 76981252 0.96
tpcds_q36/datafusion:vortex-compact 124905150 128464625 0.97
tpcds_q37/datafusion:vortex-compact 49769330 52201869 0.95
tpcds_q38/datafusion:vortex-compact 99809331 102616308 0.97
tpcds_q39/datafusion:vortex-compact 193509220 200440457 0.97
tpcds_q40/datafusion:vortex-compact 🚀 56736499 63881796 0.89
tpcds_q41/datafusion:vortex-compact 15845883 16843066 0.94
tpcds_q42/datafusion:vortex-compact 36411404 37428513 0.97
tpcds_q43/datafusion:vortex-compact 55640646 54874068 1.01
tpcds_q44/datafusion:vortex-compact 69153761 72790092 0.95
tpcds_q45/datafusion:vortex-compact 50735837 54847499 0.93
tpcds_q46/datafusion:vortex-compact 88059282 90498228 0.97
tpcds_q47/datafusion:vortex-compact 299574918 308567308 0.97
tpcds_q48/datafusion:vortex-compact 106306878 110419534 0.96
tpcds_q49/datafusion:vortex-compact 95566409 101840723 0.94
tpcds_q50/datafusion:vortex-compact 91525105 93946818 0.97
tpcds_q51/datafusion:vortex-compact 97592569 105233712 0.93
tpcds_q52/datafusion:vortex-compact 37091956 37677794 0.98
tpcds_q53/datafusion:vortex-compact 38056738 40913808 0.93
tpcds_q54/datafusion:vortex-compact 61844339 66155220 0.93
tpcds_q55/datafusion:vortex-compact 35741303 37054452 0.96
tpcds_q56/datafusion:vortex-compact 57824071 60789662 0.95
tpcds_q57/datafusion:vortex-compact 196062415 202875250 0.97
tpcds_q58/datafusion:vortex-compact 114063554 122794789 0.93
tpcds_q59/datafusion:vortex-compact 107267432 111503484 0.96
tpcds_q60/datafusion:vortex-compact 59030876 62553353 0.94
tpcds_q61/datafusion:vortex-compact 82552718 86499831 0.95
tpcds_q62/datafusion:vortex-compact 44790555 47683197 0.94
tpcds_q63/datafusion:vortex-compact 39052331 41435359 0.94
tpcds_q64/datafusion:vortex-compact 783037340 821610592 0.95
tpcds_q65/datafusion:vortex-compact 72601211 73953186 0.98
tpcds_q66/datafusion:vortex-compact 110271460 114944481 0.96
tpcds_q67/datafusion:vortex-compact 143454116 152094825 0.94
tpcds_q68/datafusion:vortex-compact 90207653 93591534 0.96
tpcds_q69/datafusion:vortex-compact 64003197 65916247 0.97
tpcds_q70/datafusion:vortex-compact 142138623 143179035 0.99
tpcds_q71/datafusion:vortex-compact 44690298 46612155 0.96
tpcds_q72/datafusion:vortex-compact 3353403235 3640248747 0.92
tpcds_q73/datafusion:vortex-compact 59304791 57830557 1.03
tpcds_q74/datafusion:vortex-compact 182775232 191513546 0.95
tpcds_q75/datafusion:vortex-compact 176557095 186835689 0.94
tpcds_q76/datafusion:vortex-compact 79544350 78152716 1.02
tpcds_q77/datafusion:vortex-compact 67807922 70206576 0.97
tpcds_q78/datafusion:vortex-compact 200978088 213829227 0.94
tpcds_q79/datafusion:vortex-compact 66715281 69566676 0.96
tpcds_q80/datafusion:vortex-compact 136924232 144813189 0.95
tpcds_q81/datafusion:vortex-compact 40893308 43415355 0.94
tpcds_q82/datafusion:vortex-compact 51133113 55623725 0.92
tpcds_q83/datafusion:vortex-compact 63314780 66764341 0.95
tpcds_q84/datafusion:vortex-compact 🚀 17175923 21109790 0.81
tpcds_q85/datafusion:vortex-compact 156975887 158855921 0.99
tpcds_q86/datafusion:vortex-compact 30950088 32407790 0.96
tpcds_q87/datafusion:vortex-compact 102545201 107292521 0.96
tpcds_q88/datafusion:vortex-compact 130032235 134282986 0.97
tpcds_q89/datafusion:vortex-compact 62741806 66877278 0.94
tpcds_q90/datafusion:vortex-compact 21679653 22616051 0.96
tpcds_q91/datafusion:vortex-compact 40852850 42621249 0.96
tpcds_q92/datafusion:vortex-compact 21339718 22824117 0.93
tpcds_q93/datafusion:vortex-compact 51133258 54036902 0.95
tpcds_q94/datafusion:vortex-compact 32841266 33585425 0.98
tpcds_q95/datafusion:vortex-compact 98092299 100011929 0.98
tpcds_q96/datafusion:vortex-compact 24239441 25664661 0.94
tpcds_q97/datafusion:vortex-compact 44394642 45785387 0.97
tpcds_q98/datafusion:vortex-compact 52787861 58494536 0.90
tpcds_q99/datafusion:vortex-compact 67121818 66261289 1.01
datafusion / parquet (0.964x ➖, 0↑ 1↓)
name PR 5881376 (ns) base 8efe1dc (ns) ratio (PR/base)
tpcds_q01/datafusion:parquet 38454893 38383933 1.00
tpcds_q02/datafusion:parquet 50189484 53511302 0.94
tpcds_q03/datafusion:parquet 15993092 17621093 0.91
tpcds_q04/datafusion:parquet 355558267 384895967 0.92
tpcds_q05/datafusion:parquet 91031196 92158061 0.99
tpcds_q06/datafusion:parquet 91930877 95384822 0.96
tpcds_q07/datafusion:parquet 137072134 139064999 0.99
tpcds_q08/datafusion:parquet 40777026 41147517 0.99
tpcds_q09/datafusion:parquet 54207140 55086105 0.98
tpcds_q10/datafusion:parquet 103567234 106796242 0.97
tpcds_q11/datafusion:parquet 223875764 244852123 0.91
tpcds_q12/datafusion:parquet 28274936 31192189 0.91
tpcds_q13/datafusion:parquet 138852883 142274987 0.98
tpcds_q14/datafusion:parquet 211592833 224815728 0.94
tpcds_q15/datafusion:parquet 58810434 55882157 1.05
tpcds_q16/datafusion:parquet 31449870 34215548 0.92
tpcds_q17/datafusion:parquet 171500382 177088841 0.97
tpcds_q18/datafusion:parquet 175419409 188179597 0.93
tpcds_q19/datafusion:parquet 36411035 36203574 1.01
tpcds_q20/datafusion:parquet 24338539 26502965 0.92
tpcds_q21/datafusion:parquet 27007404 29686187 0.91
tpcds_q22/datafusion:parquet 154135681 161844996 0.95
tpcds_q23/datafusion:parquet 176148498 192076868 0.92
tpcds_q24/datafusion:parquet 210927009 217348660 0.97
tpcds_q25/datafusion:parquet 177757618 185445271 0.96
tpcds_q26/datafusion:parquet 114808835 118435196 0.97
tpcds_q27/datafusion:parquet 244664814 267748001 0.91
tpcds_q28/datafusion:parquet 53160319 55145970 0.96
tpcds_q29/datafusion:parquet 179793200 184427284 0.97
tpcds_q30/datafusion:parquet 43767465 47256059 0.93
tpcds_q31/datafusion:parquet 106541557 107847773 0.99
tpcds_q32/datafusion:parquet 29865609 29157875 1.02
tpcds_q33/datafusion:parquet 36703219 40249502 0.91
tpcds_q34/datafusion:parquet 35769132 37521622 0.95
tpcds_q35/datafusion:parquet 95326220 101093502 0.94
tpcds_q36/datafusion:parquet 81845938 85793956 0.95
tpcds_q37/datafusion:parquet 25143006 26153005 0.96
tpcds_q38/datafusion:parquet 62724618 65820547 0.95
tpcds_q39/datafusion:parquet 99066733 102639715 0.97
tpcds_q40/datafusion:parquet 35193845 37169045 0.95
tpcds_q41/datafusion:parquet 12494464 13239430 0.94
tpcds_q42/datafusion:parquet 16311851 16169879 1.01
tpcds_q43/datafusion:parquet 27583779 27469777 1.00
tpcds_q44/datafusion:parquet 42330277 41390590 1.02
tpcds_q45/datafusion:parquet 68103336 67169258 1.01
tpcds_q46/datafusion:parquet 50950097 54397544 0.94
tpcds_q47/datafusion:parquet 188593932 194239165 0.97
tpcds_q48/datafusion:parquet 133728937 133719393 1.00
tpcds_q49/datafusion:parquet 75758874 79810134 0.95
tpcds_q50/datafusion:parquet 108187749 108683061 1.00
tpcds_q51/datafusion:parquet 97017986 105083376 0.92
tpcds_q52/datafusion:parquet 15250469 16801810 0.91
tpcds_q53/datafusion:parquet 31046379 31104789 1.00
tpcds_q54/datafusion:parquet 47327348 49090555 0.96
tpcds_q55/datafusion:parquet 15570771 16343096 0.95
tpcds_q56/datafusion:parquet 37109280 37463922 0.99
tpcds_q57/datafusion:parquet 130625991 143554073 0.91
tpcds_q58/datafusion:parquet 74440218 78415776 0.95
tpcds_q59/datafusion:parquet 69581240 68010061 1.02
tpcds_q60/datafusion:parquet 37846472 38804550 0.98
tpcds_q61/datafusion:parquet 65271044 66749848 0.98
tpcds_q62/datafusion:parquet 45898219 45050176 1.02
tpcds_q63/datafusion:parquet 31921211 33507129 0.95
tpcds_q64/datafusion:parquet 986214717 1019609684 0.97
tpcds_q65/datafusion:parquet 50843345 52018237 0.98
tpcds_q66/datafusion:parquet 88026562 93140759 0.95
tpcds_q67/datafusion:parquet 175779604 177997469 0.99
tpcds_q68/datafusion:parquet 51946126 54038431 0.96
tpcds_q69/datafusion:parquet 93824090 98087759 0.96
tpcds_q70/datafusion:parquet 105872832 112946590 0.94
tpcds_q71/datafusion:parquet 29079231 30291832 0.96
tpcds_q72/datafusion:parquet 858569345 900050318 0.95
tpcds_q73/datafusion:parquet 33444668 36587876 0.91
tpcds_q74/datafusion:parquet 131670954 130424646 1.01
tpcds_q75/datafusion:parquet 129572588 136257470 0.95
tpcds_q76/datafusion:parquet 93693171 93736322 1.00
tpcds_q77/datafusion:parquet 59264230 59170549 1.00
tpcds_q78/datafusion:parquet 181571161 190040944 0.96
tpcds_q79/datafusion:parquet 39824228 42470167 0.94
tpcds_q80/datafusion:parquet 109559024 117923777 0.93
tpcds_q81/datafusion:parquet 43449553 44399259 0.98
tpcds_q82/datafusion:parquet 29135466 28979930 1.01
tpcds_q83/datafusion:parquet 56144423 57665669 0.97
tpcds_q84/datafusion:parquet 47902347 50637891 0.95
tpcds_q85/datafusion:parquet 242432418 248462873 0.98
tpcds_q86/datafusion:parquet 21362033 22014505 0.97
tpcds_q87/datafusion:parquet 66149745 69082916 0.96
tpcds_q88/datafusion:parquet 78372946 80807119 0.97
tpcds_q89/datafusion:parquet 36817770 38429422 0.96
tpcds_q90/datafusion:parquet 18859181 19528692 0.97
tpcds_q91/datafusion:parquet 78304763 80537757 0.97
tpcds_q92/datafusion:parquet 24689738 26527901 0.93
tpcds_q93/datafusion:parquet 39392566 40319636 0.98
tpcds_q94/datafusion:parquet 28129329 29209383 0.96
tpcds_q95/datafusion:parquet 129322980 134132614 0.96
tpcds_q96/datafusion:parquet 14702359 16047937 0.92
tpcds_q97/datafusion:parquet 35736365 37505362 0.95
tpcds_q98/datafusion:parquet 36400258 38214748 0.95
tpcds_q99/datafusion:parquet 🚨 53548400 46413041 1.15
duckdb / vortex-file-compressed (0.952x ➖, 10↑ 0↓)
name PR 5881376 (ns) base 8efe1dc (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-file-compressed 26658985 27547650 0.97
tpcds_q02/duckdb:vortex-file-compressed 84667128 85864915 0.99
tpcds_q03/duckdb:vortex-file-compressed 23655788 23076927 1.03
tpcds_q04/duckdb:vortex-file-compressed 106342823 109875995 0.97
tpcds_q05/duckdb:vortex-file-compressed 102092069 102299788 1.00
tpcds_q06/duckdb:vortex-file-compressed 36021327 36728284 0.98
tpcds_q07/duckdb:vortex-file-compressed 25044927 24080618 1.04
tpcds_q08/duckdb:vortex-file-compressed 24150243 24184392 1.00
tpcds_q09/duckdb:vortex-file-compressed 39894164 42537561 0.94
tpcds_q10/duckdb:vortex-file-compressed 35884763 38456124 0.93
tpcds_q11/duckdb:vortex-file-compressed 61877015 63346868 0.98
tpcds_q12/duckdb:vortex-file-compressed 🚀 13741298 15384901 0.89
tpcds_q13/duckdb:vortex-file-compressed 32409960 33963898 0.95
tpcds_q14/duckdb:vortex-file-compressed 196892082 197918841 0.99
tpcds_q15/duckdb:vortex-file-compressed 41520904 42639742 0.97
tpcds_q16/duckdb:vortex-file-compressed 30812571 32210738 0.96
tpcds_q17/duckdb:vortex-file-compressed 37635627 39650708 0.95
tpcds_q18/duckdb:vortex-file-compressed 46847422 48052686 0.97
tpcds_q19/duckdb:vortex-file-compressed 31598062 33650581 0.94
tpcds_q20/duckdb:vortex-file-compressed 15497215 16494727 0.94
tpcds_q21/duckdb:vortex-file-compressed 19944115 19975976 1.00
tpcds_q22/duckdb:vortex-file-compressed 108892765 114759487 0.95
tpcds_q23/duckdb:vortex-file-compressed 126910308 139216061 0.91
tpcds_q24/duckdb:vortex-file-compressed 54026414 58178456 0.93
tpcds_q25/duckdb:vortex-file-compressed 36273426 38281097 0.95
tpcds_q26/duckdb:vortex-file-compressed 39271877 42618330 0.92
tpcds_q27/duckdb:vortex-file-compressed 88712604 89797437 0.99
tpcds_q28/duckdb:vortex-file-compressed 36969102 37862484 0.98
tpcds_q29/duckdb:vortex-file-compressed 36038048 38876575 0.93
tpcds_q30/duckdb:vortex-file-compressed 28642722 28653433 1.00
tpcds_q31/duckdb:vortex-file-compressed 🚀 25347097 28660230 0.88
tpcds_q32/duckdb:vortex-file-compressed 16860534 16815625 1.00
tpcds_q33/duckdb:vortex-file-compressed 68017470 72833272 0.93
tpcds_q34/duckdb:vortex-file-compressed 18941599 19186366 0.99
tpcds_q35/duckdb:vortex-file-compressed 63465107 68351071 0.93
tpcds_q36/duckdb:vortex-file-compressed 27580527 27618506 1.00
tpcds_q37/duckdb:vortex-file-compressed 21113824 22414720 0.94
tpcds_q38/duckdb:vortex-file-compressed 37295013 38074527 0.98
tpcds_q39/duckdb:vortex-file-compressed 43115990 46247099 0.93
tpcds_q40/duckdb:vortex-file-compressed 24334476 26496274 0.92
tpcds_q41/duckdb:vortex-file-compressed 13038704 13834946 0.94
tpcds_q42/duckdb:vortex-file-compressed 12475941 12252312 1.02
tpcds_q43/duckdb:vortex-file-compressed 20144885 21810141 0.92
tpcds_q44/duckdb:vortex-file-compressed 25522869 26499822 0.96
tpcds_q45/duckdb:vortex-file-compressed 26626217 27882386 0.95
tpcds_q46/duckdb:vortex-file-compressed 47678501 48621085 0.98
tpcds_q47/duckdb:vortex-file-compressed 50795484 52139758 0.97
tpcds_q48/duckdb:vortex-file-compressed 29415534 30081130 0.98
tpcds_q49/duckdb:vortex-file-compressed 🚀 29694573 33454294 0.89
tpcds_q50/duckdb:vortex-file-compressed 33806943 35518962 0.95
tpcds_q51/duckdb:vortex-file-compressed 101005729 109194295 0.93
tpcds_q52/duckdb:vortex-file-compressed 🚀 12012444 13672669 0.88
tpcds_q53/duckdb:vortex-file-compressed 🚀 16442963 18439117 0.89
tpcds_q54/duckdb:vortex-file-compressed 46759886 49079571 0.95
tpcds_q55/duckdb:vortex-file-compressed 12071429 11936996 1.01
tpcds_q56/duckdb:vortex-file-compressed 69227403 69736840 0.99
tpcds_q57/duckdb:vortex-file-compressed 44527753 47660058 0.93
tpcds_q58/duckdb:vortex-file-compressed 33217382 36029509 0.92
tpcds_q59/duckdb:vortex-file-compressed 55478039 58460806 0.95
tpcds_q60/duckdb:vortex-file-compressed 70059945 71672226 0.98
tpcds_q61/duckdb:vortex-file-compressed 38128285 37990767 1.00
tpcds_q62/duckdb:vortex-file-compressed 🚀 18160559 21581944 0.84
tpcds_q63/duckdb:vortex-file-compressed 18522818 18523803 1.00
tpcds_q64/duckdb:vortex-file-compressed 77517340 84699066 0.92
tpcds_q65/duckdb:vortex-file-compressed 24153494 24339939 0.99
tpcds_q66/duckdb:vortex-file-compressed 56797256 59201660 0.96
tpcds_q67/duckdb:vortex-file-compressed 144945628 149212597 0.97
tpcds_q68/duckdb:vortex-file-compressed 41121291 41093296 1.00
tpcds_q69/duckdb:vortex-file-compressed 38132840 40061832 0.95
tpcds_q70/duckdb:vortex-file-compressed 25672011 25407282 1.01
tpcds_q71/duckdb:vortex-file-compressed 20636083 22327388 0.92
tpcds_q72/duckdb:vortex-file-compressed 179054299 183489444 0.98
tpcds_q73/duckdb:vortex-file-compressed 19335145 20970750 0.92
tpcds_q74/duckdb:vortex-file-compressed 52681024 54273615 0.97
tpcds_q75/duckdb:vortex-file-compressed 🚀 59037027 66515366 0.89
tpcds_q76/duckdb:vortex-file-compressed 61566063 62318830 0.99
tpcds_q77/duckdb:vortex-file-compressed 66910922 72895500 0.92
tpcds_q78/duckdb:vortex-file-compressed 78638845 83668498 0.94
tpcds_q79/duckdb:vortex-file-compressed 35469903 37908799 0.94
tpcds_q80/duckdb:vortex-file-compressed 🚀 88331322 102387427 0.86
tpcds_q81/duckdb:vortex-file-compressed 32914714 33999670 0.97
tpcds_q82/duckdb:vortex-file-compressed 22883042 23500851 0.97
tpcds_q83/duckdb:vortex-file-compressed 🚀 26312395 30763947 0.86
tpcds_q84/duckdb:vortex-file-compressed 17256327 18208170 0.95
tpcds_q85/duckdb:vortex-file-compressed 47001453 46873890 1.00
tpcds_q86/duckdb:vortex-file-compressed 16811601 16691077 1.01
tpcds_q87/duckdb:vortex-file-compressed 40165163 41349038 0.97
tpcds_q88/duckdb:vortex-file-compressed 40745269 44681945 0.91
tpcds_q89/duckdb:vortex-file-compressed 18062878 18672666 0.97
tpcds_q90/duckdb:vortex-file-compressed 14660313 15660756 0.94
tpcds_q91/duckdb:vortex-file-compressed 26345052 28554317 0.92
tpcds_q92/duckdb:vortex-file-compressed 14340502 15771156 0.91
tpcds_q93/duckdb:vortex-file-compressed 31256150 32437684 0.96
tpcds_q94/duckdb:vortex-file-compressed 🚀 20312023 24014346 0.85
tpcds_q95/duckdb:vortex-file-compressed 147821677 158965678 0.93
tpcds_q96/duckdb:vortex-file-compressed 17800047 18722584 0.95
tpcds_q97/duckdb:vortex-file-compressed 38822152 39854929 0.97
tpcds_q98/duckdb:vortex-file-compressed 18548292 19686493 0.94
tpcds_q99/duckdb:vortex-file-compressed 32160161 33055614 0.97
duckdb / vortex-compact (0.972x ➖, 1↑ 0↓)
name PR 5881376 (ns) base 8efe1dc (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-compact 33425966 36480821 0.92
tpcds_q02/duckdb:vortex-compact 123612107 128854799 0.96
tpcds_q03/duckdb:vortex-compact 50383833 52312347 0.96
tpcds_q04/duckdb:vortex-compact 125728092 127817181 0.98
tpcds_q05/duckdb:vortex-compact 171107274 179453280 0.95
tpcds_q06/duckdb:vortex-compact 43384191 42011568 1.03
tpcds_q07/duckdb:vortex-compact 40657835 41329117 0.98
tpcds_q08/duckdb:vortex-compact 31468682 30571788 1.03
tpcds_q09/duckdb:vortex-compact 112846320 117182961 0.96
tpcds_q10/duckdb:vortex-compact 48455489 50441325 0.96
tpcds_q11/duckdb:vortex-compact 74529340 82485811 0.90
tpcds_q12/duckdb:vortex-compact 21256285 21801505 0.97
tpcds_q13/duckdb:vortex-compact 54070384 55015716 0.98
tpcds_q14/duckdb:vortex-compact 291664501 307598391 0.95
tpcds_q15/duckdb:vortex-compact 45781589 47284487 0.97
tpcds_q16/duckdb:vortex-compact 42805669 39799983 1.08
tpcds_q17/duckdb:vortex-compact 56868501 54068868 1.05
tpcds_q18/duckdb:vortex-compact 70572012 70781406 1.00
tpcds_q19/duckdb:vortex-compact 42617754 41570351 1.03
tpcds_q20/duckdb:vortex-compact 20287473 21460148 0.95
tpcds_q21/duckdb:vortex-compact 28399700 28831093 0.99
tpcds_q22/duckdb:vortex-compact 115933528 124820627 0.93
tpcds_q23/duckdb:vortex-compact 175549258 183942887 0.95
tpcds_q24/duckdb:vortex-compact 81151872 78996834 1.03
tpcds_q25/duckdb:vortex-compact 52078863 53131658 0.98
tpcds_q26/duckdb:vortex-compact 55822896 55292529 1.01
tpcds_q27/duckdb:vortex-compact 145813727 146283215 1.00
tpcds_q28/duckdb:vortex-compact 108551644 110039630 0.99
tpcds_q29/duckdb:vortex-compact 53142335 55395339 0.96
tpcds_q30/duckdb:vortex-compact 35711879 37113665 0.96
tpcds_q31/duckdb:vortex-compact 29584041 32531147 0.91
tpcds_q32/duckdb:vortex-compact 24348284 24686463 0.99
tpcds_q33/duckdb:vortex-compact 143917120 150980547 0.95
tpcds_q34/duckdb:vortex-compact 30265645 30399806 1.00
tpcds_q35/duckdb:vortex-compact 80061129 74644709 1.07
tpcds_q36/duckdb:vortex-compact 36729661 35630148 1.03
tpcds_q37/duckdb:vortex-compact 31795084 32381986 0.98
tpcds_q38/duckdb:vortex-compact 43820970 42206504 1.04
tpcds_q39/duckdb:vortex-compact 54088296 55904698 0.97
tpcds_q40/duckdb:vortex-compact 30872152 32770187 0.94
tpcds_q41/duckdb:vortex-compact 16356797 16897233 0.97
tpcds_q42/duckdb:vortex-compact 15509437 15590955 0.99
tpcds_q43/duckdb:vortex-compact 24170885 25375529 0.95
tpcds_q44/duckdb:vortex-compact 35636462 35721279 1.00
tpcds_q45/duckdb:vortex-compact 31937687 34206031 0.93
tpcds_q46/duckdb:vortex-compact 62885144 63094998 1.00
tpcds_q47/duckdb:vortex-compact 55056847 57849663 0.95
tpcds_q48/duckdb:vortex-compact 46197443 45657555 1.01
tpcds_q49/duckdb:vortex-compact 49837207 48498489 1.03
tpcds_q50/duckdb:vortex-compact 54861915 57300375 0.96
tpcds_q51/duckdb:vortex-compact 107811817 108393450 0.99
tpcds_q52/duckdb:vortex-compact 15792626 16565939 0.95
tpcds_q53/duckdb:vortex-compact 22318961 23820127 0.94
tpcds_q54/duckdb:vortex-compact 87507908 90464054 0.97
tpcds_q55/duckdb:vortex-compact 15663567 16624530 0.94
tpcds_q56/duckdb:vortex-compact 143300279 149330147 0.96
tpcds_q57/duckdb:vortex-compact 47883733 49855209 0.96
tpcds_q58/duckdb:vortex-compact 41011750 43832717 0.94
tpcds_q59/duckdb:vortex-compact 71772430 68281817 1.05
tpcds_q60/duckdb:vortex-compact 148526952 159096464 0.93
tpcds_q61/duckdb:vortex-compact 53386258 55842159 0.96
tpcds_q62/duckdb:vortex-compact 22941635 23881095 0.96
tpcds_q63/duckdb:vortex-compact 22424861 23987637 0.93
tpcds_q64/duckdb:vortex-compact 110115296 116194174 0.95
tpcds_q65/duckdb:vortex-compact 28389542 30241792 0.94
tpcds_q66/duckdb:vortex-compact 104874040 107920133 0.97
tpcds_q67/duckdb:vortex-compact 160434711 161374857 0.99
tpcds_q68/duckdb:vortex-compact 57467613 58886277 0.98
tpcds_q69/duckdb:vortex-compact 49135141 52885220 0.93
tpcds_q70/duckdb:vortex-compact 29981955 30747649 0.98
tpcds_q71/duckdb:vortex-compact 26652478 28885395 0.92
tpcds_q72/duckdb:vortex-compact 197938651 205540630 0.96
tpcds_q73/duckdb:vortex-compact 31505378 29826382 1.06
tpcds_q74/duckdb:vortex-compact 63334695 63352575 1.00
tpcds_q75/duckdb:vortex-compact 69603916 76698194 0.91
tpcds_q76/duckdb:vortex-compact 135323584 149875313 0.90
tpcds_q77/duckdb:vortex-compact 140002160 140617947 1.00
tpcds_q78/duckdb:vortex-compact 87769925 90752292 0.97
tpcds_q79/duckdb:vortex-compact 59909374 63461494 0.94
tpcds_q80/duckdb:vortex-compact 184520085 184842508 1.00
tpcds_q81/duckdb:vortex-compact 40865278 43377040 0.94
tpcds_q82/duckdb:vortex-compact 31985188 32476616 0.98
tpcds_q83/duckdb:vortex-compact 46379420 47395150 0.98
tpcds_q84/duckdb:vortex-compact 21441810 23074793 0.93
tpcds_q85/duckdb:vortex-compact 61907570 63799730 0.97
tpcds_q86/duckdb:vortex-compact 19738970 21471752 0.92
tpcds_q87/duckdb:vortex-compact 44386066 43654013 1.02
tpcds_q88/duckdb:vortex-compact 41816026 46096068 0.91
tpcds_q89/duckdb:vortex-compact 23385533 24112335 0.97
tpcds_q90/duckdb:vortex-compact 16879806 16535323 1.02
tpcds_q91/duckdb:vortex-compact 46512139 47882506 0.97
tpcds_q92/duckdb:vortex-compact 21210812 21381700 0.99
tpcds_q93/duckdb:vortex-compact 38536445 41048306 0.94
tpcds_q94/duckdb:vortex-compact 28160941 29662932 0.95
tpcds_q95/duckdb:vortex-compact 158394888 163707113 0.97
tpcds_q96/duckdb:vortex-compact 20781502 19904808 1.04
tpcds_q97/duckdb:vortex-compact 🚀 40522461 46874321 0.86
tpcds_q98/duckdb:vortex-compact 23493507 24386253 0.96
tpcds_q99/duckdb:vortex-compact 37486178 37719469 0.99
duckdb / parquet (0.973x ➖, 5↑ 1↓)
name PR 5881376 (ns) base 8efe1dc (ns) ratio (PR/base)
tpcds_q01/duckdb:parquet 44924720 45531705 0.99
tpcds_q02/duckdb:parquet 61316922 63679952 0.96
tpcds_q03/duckdb:parquet 12146384 12450660 0.98
tpcds_q04/duckdb:parquet 125029946 127768178 0.98
tpcds_q05/duckdb:parquet 73708922 77166581 0.96
tpcds_q06/duckdb:parquet 28198198 29389156 0.96
tpcds_q07/duckdb:parquet 22994195 23776336 0.97
tpcds_q08/duckdb:parquet 27652648 28458009 0.97
tpcds_q09/duckdb:parquet 39370242 40142953 0.98
tpcds_q10/duckdb:parquet 34032281 35981840 0.95
tpcds_q11/duckdb:parquet 89147530 90590649 0.98
tpcds_q12/duckdb:parquet 14533736 15178806 0.96
tpcds_q13/duckdb:parquet 33948999 35873383 0.95
tpcds_q14/duckdb:parquet 166770000 162674434 1.03
tpcds_q15/duckdb:parquet 30170296 31561995 0.96
tpcds_q16/duckdb:parquet 21501077 22115393 0.97
tpcds_q17/duckdb:parquet 36919263 39593696 0.93
tpcds_q18/duckdb:parquet 46111551 46303569 1.00
tpcds_q19/duckdb:parquet 29111121 30921519 0.94
tpcds_q20/duckdb:parquet 14915678 15110844 0.99
tpcds_q21/duckdb:parquet 11194509 11313382 0.99
tpcds_q22/duckdb:parquet 🚀 64587537 72843131 0.89
tpcds_q23/duckdb:parquet 109294131 116144293 0.94
tpcds_q24/duckdb:parquet 44356982 46756904 0.95
tpcds_q25/duckdb:parquet 33462048 33431411 1.00
tpcds_q26/duckdb:parquet 35641244 38504071 0.93
tpcds_q27/duckdb:parquet 88655877 90476824 0.98
tpcds_q28/duckdb:parquet 37724026 38052725 0.99
tpcds_q29/duckdb:parquet 35791520 36388013 0.98
tpcds_q30/duckdb:parquet 38228340 41718501 0.92
tpcds_q31/duckdb:parquet 23287493 23388519 1.00
tpcds_q32/duckdb:parquet 10846549 11325938 0.96
tpcds_q33/duckdb:parquet 69554195 70495748 0.99
tpcds_q34/duckdb:parquet 20597093 20868307 0.99
tpcds_q35/duckdb:parquet 57038895 59841214 0.95
tpcds_q36/duckdb:parquet 20541617 20492844 1.00
tpcds_q37/duckdb:parquet 13328825 13899909 0.96
tpcds_q38/duckdb:parquet 33454542 33965794 0.98
tpcds_q39/duckdb:parquet 🚨 39185892 33332064 1.18
tpcds_q40/duckdb:parquet 18278202 18403666 0.99
tpcds_q41/duckdb:parquet 7644641 7646849 1.00
tpcds_q42/duckdb:parquet 10226577 10433206 0.98
tpcds_q43/duckdb:parquet 15435204 16787921 0.92
tpcds_q44/duckdb:parquet 21310701 21542763 0.99
tpcds_q45/duckdb:parquet 26963542 26091391 1.03
tpcds_q46/duckdb:parquet 46794572 44838529 1.04
tpcds_q47/duckdb:parquet 44460194 45712251 0.97
tpcds_q48/duckdb:parquet 30468967 30572907 1.00
tpcds_q49/duckdb:parquet 23853429 23410372 1.02
tpcds_q50/duckdb:parquet 24217718 24577156 0.99
tpcds_q51/duckdb:parquet 94287723 102178864 0.92
tpcds_q52/duckdb:parquet 10876627 11804516 0.92
tpcds_q53/duckdb:parquet 16446467 16725975 0.98
tpcds_q54/duckdb:parquet 41562833 40148740 1.04
tpcds_q55/duckdb:parquet 10572082 10808707 0.98
tpcds_q56/duckdb:parquet 67671680 70185593 0.96
tpcds_q57/duckdb:parquet 34666765 34759835 1.00
tpcds_q58/duckdb:parquet 21284366 21557600 0.99
tpcds_q59/duckdb:parquet 36212241 36626484 0.99
tpcds_q60/duckdb:parquet 72710196 71302897 1.02
tpcds_q61/duckdb:parquet 30253927 30372813 1.00
tpcds_q62/duckdb:parquet 11391995 11517801 0.99
tpcds_q63/duckdb:parquet 15288775 15836724 0.97
tpcds_q64/duckdb:parquet 73259278 75346619 0.97
tpcds_q65/duckdb:parquet 20849168 22424062 0.93
tpcds_q66/duckdb:parquet 53036465 56860175 0.93
tpcds_q67/duckdb:parquet 133695341 137503377 0.97
tpcds_q68/duckdb:parquet 38546722 37686792 1.02
tpcds_q69/duckdb:parquet 37837377 38491009 0.98
tpcds_q70/duckdb:parquet 19268914 19831406 0.97
tpcds_q71/duckdb:parquet 18408827 18325607 1.00
tpcds_q72/duckdb:parquet 165738507 166107894 1.00
tpcds_q73/duckdb:parquet 17794948 18953684 0.94
tpcds_q74/duckdb:parquet 49615735 51392347 0.97
tpcds_q75/duckdb:parquet 52083470 55051340 0.95
tpcds_q76/duckdb:parquet 🚀 64867359 72243876 0.90
tpcds_q77/duckdb:parquet 62144970 64638649 0.96
tpcds_q78/duckdb:parquet 74195065 76672840 0.97
tpcds_q79/duckdb:parquet 27605439 27877184 0.99
tpcds_q80/duckdb:parquet 🚀 77838564 87073444 0.89
tpcds_q81/duckdb:parquet 46708413 48564826 0.96
tpcds_q82/duckdb:parquet 14996651 15763445 0.95
tpcds_q83/duckdb:parquet 15672859 17143337 0.91
tpcds_q84/duckdb:parquet 19601809 20237656 0.97
tpcds_q85/duckdb:parquet 38118976 40784981 0.93
tpcds_q86/duckdb:parquet 12995069 12884262 1.01
tpcds_q87/duckdb:parquet 38229011 37772796 1.01
tpcds_q88/duckdb:parquet 29281556 29691356 0.99
tpcds_q89/duckdb:parquet 17057617 17761847 0.96
tpcds_q90/duckdb:parquet 7992025 7687069 1.04
tpcds_q91/duckdb:parquet 23417588 22739778 1.03
tpcds_q92/duckdb:parquet 🚀 10878831 12889462 0.84
tpcds_q93/duckdb:parquet 29895602 30722154 0.97
tpcds_q94/duckdb:parquet 16074275 16461261 0.98
tpcds_q95/duckdb:parquet 137595516 130369436 1.06
tpcds_q96/duckdb:parquet 🚀 9077099 10418860 0.87
tpcds_q97/duckdb:parquet 34818209 36443479 0.96
tpcds_q98/duckdb:parquet 17930690 18263105 0.98
tpcds_q99/duckdb:parquet 19798146 20119202 0.98
duckdb / duckdb (0.983x ➖, 4↑ 6↓)
name PR 5881376 (ns) base 8efe1dc (ns) ratio (PR/base)
tpcds_q01/duckdb:duckdb 🚀 19208440 21659030 0.89
tpcds_q02/duckdb:duckdb 19347815 18634259 1.04
tpcds_q03/duckdb:duckdb 🚨 10176534 8789024 1.16
tpcds_q04/duckdb:duckdb 166727166 166566565 1.00
tpcds_q05/duckdb:duckdb 18655101 18868043 0.99
tpcds_q06/duckdb:duckdb 22519688 23101346 0.97
tpcds_q07/duckdb:duckdb 38740252 39426485 0.98
tpcds_q08/duckdb:duckdb 120131507 120724023 1.00
tpcds_q09/duckdb:duckdb 19756374 20239914 0.98
tpcds_q10/duckdb:duckdb 22822243 24044915 0.95
tpcds_q11/duckdb:duckdb 140970363 140097879 1.01
tpcds_q12/duckdb:duckdb 🚨 12957630 11688475 1.11
tpcds_q13/duckdb:duckdb 24318560 24674519 0.99
tpcds_q14/duckdb:duckdb 96127079 95362907 1.01
tpcds_q15/duckdb:duckdb 24186000 25919478 0.93
tpcds_q16/duckdb:duckdb 18096984 18229522 0.99
tpcds_q17/duckdb:duckdb 21828012 22561395 0.97
tpcds_q18/duckdb:duckdb 43015621 45913154 0.94
tpcds_q19/duckdb:duckdb 16042698 16551661 0.97
tpcds_q20/duckdb:duckdb 11424338 12129253 0.94
tpcds_q21/duckdb:duckdb 🚀 6562527 8193441 0.80
tpcds_q22/duckdb:duckdb 60983070 67338318 0.91
tpcds_q23/duckdb:duckdb 75207385 82189425 0.92
tpcds_q24/duckdb:duckdb 22988174 24941833 0.92
tpcds_q25/duckdb:duckdb 16114267 16695360 0.97
tpcds_q26/duckdb:duckdb 26500811 25944494 1.02
tpcds_q27/duckdb:duckdb 39432873 41404946 0.95
tpcds_q28/duckdb:duckdb 21295096 21543883 0.99
tpcds_q29/duckdb:duckdb 20220544 20878066 0.97
tpcds_q30/duckdb:duckdb 28653109 31021053 0.92
tpcds_q31/duckdb:duckdb 20158987 20996911 0.96
tpcds_q32/duckdb:duckdb 6823397 7570847 0.90
tpcds_q33/duckdb:duckdb 12559199 12755949 0.98
tpcds_q34/duckdb:duckdb 15015849 15602349 0.96
tpcds_q35/duckdb:duckdb 33269822 32891673 1.01
tpcds_q36/duckdb:duckdb 76928529 74123465 1.04
tpcds_q37/duckdb:duckdb 7865192 7915042 0.99
tpcds_q38/duckdb:duckdb 32132562 30818168 1.04
tpcds_q39/duckdb:duckdb 26947731 26893643 1.00
tpcds_q40/duckdb:duckdb 14167246 14118703 1.00
tpcds_q41/duckdb:duckdb 8667524 8806462 0.98
tpcds_q42/duckdb:duckdb 6902768 6767842 1.02
tpcds_q43/duckdb:duckdb 11343279 11520972 0.98
tpcds_q44/duckdb:duckdb 13151829 13601476 0.97
tpcds_q45/duckdb:duckdb 16776165 17633069 0.95
tpcds_q46/duckdb:duckdb 37923090 38171412 0.99
tpcds_q47/duckdb:duckdb 41121393 40982366 1.00
tpcds_q48/duckdb:duckdb 21474400 23445449 0.92
tpcds_q49/duckdb:duckdb 16243614 17471734 0.93
tpcds_q50/duckdb:duckdb 14063555 14928510 0.94
tpcds_q51/duckdb:duckdb 90542564 93387716 0.97
tpcds_q52/duckdb:duckdb 7245423 7284977 0.99
tpcds_q53/duckdb:duckdb 11580244 11963640 0.97
tpcds_q54/duckdb:duckdb 17418339 17206147 1.01
tpcds_q55/duckdb:duckdb 6989704 7215346 0.97
tpcds_q56/duckdb:duckdb 13539332 14207647 0.95
tpcds_q57/duckdb:duckdb 34376404 31352883 1.10
tpcds_q58/duckdb:duckdb 12357210 13532318 0.91
tpcds_q59/duckdb:duckdb 35909620 35073727 1.02
tpcds_q60/duckdb:duckdb 15506289 15096432 1.03
tpcds_q61/duckdb:duckdb 14459305 14296110 1.01
tpcds_q62/duckdb:duckdb 9384241 9102032 1.03
tpcds_q63/duckdb:duckdb 11647890 11654759 1.00
tpcds_q64/duckdb:duckdb 52556813 54893724 0.96
tpcds_q65/duckdb:duckdb 33058261 32741434 1.01
tpcds_q66/duckdb:duckdb 24875662 24463354 1.02
tpcds_q67/duckdb:duckdb 127574521 134250938 0.95
tpcds_q68/duckdb:duckdb 24909545 25279222 0.99
tpcds_q69/duckdb:duckdb 25099378 24213837 1.04
tpcds_q70/duckdb:duckdb 🚨 16008508 14210359 1.13
tpcds_q71/duckdb:duckdb 🚨 14346138 12977693 1.11
tpcds_q72/duckdb:duckdb 43861103 43757582 1.00
tpcds_q73/duckdb:duckdb 11325240 10485023 1.08
tpcds_q74/duckdb:duckdb 98568330 100721178 0.98
tpcds_q75/duckdb:duckdb 42708777 43511534 0.98
tpcds_q76/duckdb:duckdb 11310015 11860588 0.95
tpcds_q77/duckdb:duckdb 11404556 12346247 0.92
tpcds_q78/duckdb:duckdb 63129799 65969114 0.96
tpcds_q79/duckdb:duckdb 18108944 18972154 0.95
tpcds_q80/duckdb:duckdb 27427486 29871555 0.92
tpcds_q81/duckdb:duckdb 36384040 37987871 0.96
tpcds_q82/duckdb:duckdb 🚀 7960092 9034159 0.88
tpcds_q83/duckdb:duckdb 9229307 9269125 1.00
tpcds_q84/duckdb:duckdb 13713589 13656276 1.00
tpcds_q85/duckdb:duckdb 24044756 25655594 0.94
tpcds_q86/duckdb:duckdb 10802247 10470246 1.03
tpcds_q87/duckdb:duckdb 🚨 37376425 32234709 1.16
tpcds_q88/duckdb:duckdb 25119929 24581795 1.02
tpcds_q89/duckdb:duckdb 13897773 13807281 1.01
tpcds_q90/duckdb:duckdb 6181106 5864776 1.05
tpcds_q91/duckdb:duckdb 🚨 13642567 12398451 1.10
tpcds_q92/duckdb:duckdb 8481579 8984865 0.94
tpcds_q93/duckdb:duckdb 🚀 20745259 23604486 0.88
tpcds_q94/duckdb:duckdb 12714035 13448959 0.95
tpcds_q95/duckdb:duckdb 128593843 131896308 0.97
tpcds_q96/duckdb:duckdb 4478878 4644392 0.96
tpcds_q97/duckdb:duckdb 31441516 30948748 1.02
tpcds_q98/duckdb:duckdb 13437622 14053522 0.96
tpcds_q99/duckdb:duckdb 16051300 16536705 0.97
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact -5.7% -0.6% -5.1% +10.0% ➖ noise
1 datafusion:vortex-file-compressed -7.8% -0.6% -7.2% +17.3% ➖ noise
1 duckdb:duckdb -11.3% -0.6% -10.8% +12.2% ➖ noise
1 duckdb:vortex-compact -8.4% -0.6% -7.8% +12.5% ➖ noise
1 duckdb:vortex-file-compressed -3.2% -0.6% -2.7% +11.4% ➖ noise
2 datafusion:vortex-compact -1.0% -5.0% +4.1% +10.1% ➖ noise
2 datafusion:vortex-file-compressed +3.2% -5.0% +8.6% +11.2% ➖ noise
2 duckdb:duckdb +3.8% -5.0% +9.3% +27.4% ➖ noise
2 duckdb:vortex-compact -4.1% -5.0% +0.9% +10.0% ➖ noise
2 duckdb:vortex-file-compressed -1.4% -5.0% +3.8% +13.1% ➖ noise
3 datafusion:vortex-compact +0.6% -5.9% +6.9% +12.8% ➖ noise
3 datafusion:vortex-file-compressed -5.3% -5.9% +0.7% +12.7% ➖ noise
3 duckdb:duckdb +15.8% -5.9% +23.1% +19.4% 🚨 regression
3 duckdb:vortex-compact -3.7% -5.9% +2.4% +17.6% ➖ noise
3 duckdb:vortex-file-compressed +2.5% -5.9% +8.9% +14.2% ➖ noise
4 datafusion:vortex-compact -3.4% -4.9% +1.6% +10.0% ➖ noise
4 datafusion:vortex-file-compressed -6.4% -4.9% -1.6% +10.0% ➖ noise
4 duckdb:duckdb +0.1% -4.9% +5.3% +10.0% ➖ noise
4 duckdb:vortex-compact -1.6% -4.9% +3.5% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -3.2% -4.9% +1.8% +10.0% ➖ noise
5 datafusion:vortex-compact -3.4% -2.9% -0.5% +10.0% ➖ noise
5 datafusion:vortex-file-compressed -1.5% -2.9% +1.4% +10.0% ➖ noise
5 duckdb:duckdb -1.1% -2.9% +1.8% +10.1% ➖ noise
5 duckdb:vortex-compact -4.7% -2.9% -1.8% +13.6% ➖ noise
5 duckdb:vortex-file-compressed -0.2% -2.9% +2.7% +18.1% ➖ noise
6 datafusion:vortex-compact -6.7% -3.8% -3.0% +10.0% ➖ noise
6 datafusion:vortex-file-compressed -4.4% -3.8% -0.6% +10.0% ➖ noise
6 duckdb:duckdb -2.5% -3.8% +1.4% +13.9% ➖ noise
6 duckdb:vortex-compact +3.3% -3.8% +7.4% +10.0% ➖ noise
6 duckdb:vortex-file-compressed -1.9% -3.8% +2.0% +10.0% ➖ noise
7 datafusion:vortex-compact -2.5% -2.4% -0.1% +10.0% ➖ noise
7 datafusion:vortex-file-compressed -1.6% -2.4% +0.8% +10.0% ➖ noise
7 duckdb:duckdb -1.7% -2.4% +0.6% +17.7% ➖ noise
7 duckdb:vortex-compact -1.6% -2.4% +0.8% +10.0% ➖ noise
7 duckdb:vortex-file-compressed +4.0% -2.4% +6.5% +12.1% ➖ noise
8 datafusion:vortex-compact -0.1% -1.9% +1.8% +10.0% ➖ noise
8 datafusion:vortex-file-compressed +0.5% -1.9% +2.4% +10.0% ➖ noise
8 duckdb:duckdb -0.5% -1.9% +1.4% +10.0% ➖ noise
8 duckdb:vortex-compact +2.9% -1.9% +4.9% +10.0% ➖ noise
8 duckdb:vortex-file-compressed -0.1% -1.9% +1.8% +10.0% ➖ noise
9 datafusion:vortex-compact -2.5% -1.8% -0.7% +10.0% ➖ noise
9 datafusion:vortex-file-compressed -5.9% -1.8% -4.2% +10.0% ➖ noise
9 duckdb:duckdb -2.4% -1.8% -0.6% +10.0% ➖ noise
9 duckdb:vortex-compact -3.7% -1.8% -2.0% +10.0% ➖ noise
9 duckdb:vortex-file-compressed -6.2% -1.8% -4.5% +10.0% ➖ noise
10 datafusion:vortex-compact -6.4% -4.2% -2.3% +10.0% ➖ noise
10 datafusion:vortex-file-compressed +0.2% -4.2% +4.7% +10.0% ➖ noise
10 duckdb:duckdb -5.1% -4.2% -0.9% +10.0% ➖ noise
10 duckdb:vortex-compact -3.9% -4.2% +0.3% +10.0% ➖ noise
10 duckdb:vortex-file-compressed -6.7% -4.2% -2.6% +10.0% ➖ noise
11 datafusion:vortex-compact -2.5% -5.1% +2.8% +10.0% ➖ noise
11 datafusion:vortex-file-compressed -3.5% -5.1% +1.8% +10.0% ➖ noise
11 duckdb:duckdb +0.6% -5.1% +6.1% +10.0% ➖ noise
11 duckdb:vortex-compact -9.6% -5.1% -4.7% +10.0% ➖ noise
11 duckdb:vortex-file-compressed -2.3% -5.1% +3.0% +10.1% ➖ noise
12 datafusion:vortex-compact -9.5% -6.8% -2.8% +10.0% ➖ noise
12 datafusion:vortex-file-compressed -0.1% -6.8% +7.2% +12.4% ➖ noise
12 duckdb:duckdb +10.9% -6.8% +19.0% +14.7% 🚨 regression
12 duckdb:vortex-compact -2.5% -6.8% +4.7% +16.6% ➖ noise
12 duckdb:vortex-file-compressed -10.7% -6.8% -4.1% +10.6% ➖ noise
13 datafusion:vortex-compact -5.1% -3.9% -1.3% +10.0% ➖ noise
13 datafusion:vortex-file-compressed -4.7% -3.9% -0.9% +10.0% ➖ noise
13 duckdb:duckdb -1.4% -3.9% +2.6% +10.0% ➖ noise
13 duckdb:vortex-compact -1.7% -3.9% +2.3% +11.1% ➖ noise
13 duckdb:vortex-file-compressed -4.6% -3.9% -0.7% +10.0% ➖ noise
14 datafusion:vortex-compact -6.6% -1.8% -4.9% +10.0% ➖ noise
14 datafusion:vortex-file-compressed -6.1% -1.8% -4.4% +10.0% ➖ noise
14 duckdb:duckdb +0.8% -1.8% +2.6% +10.0% ➖ noise
14 duckdb:vortex-compact -5.2% -1.8% -3.5% +10.0% ➖ noise
14 duckdb:vortex-file-compressed -0.5% -1.8% +1.3% +12.4% ➖ noise
15 datafusion:vortex-compact -4.8% +0.3% -5.0% +10.0% ➖ noise
15 datafusion:vortex-file-compressed -7.3% +0.3% -7.5% +10.0% ➖ noise
15 duckdb:duckdb -6.7% +0.3% -7.0% +12.9% ➖ noise
15 duckdb:vortex-compact -3.2% +0.3% -3.5% +12.9% ➖ noise
15 duckdb:vortex-file-compressed -2.6% +0.3% -2.9% +10.0% ➖ noise
16 datafusion:vortex-compact -1.7% -5.5% +4.0% +11.1% ➖ noise
16 datafusion:vortex-file-compressed -9.4% -5.5% -4.2% +10.0% ➖ noise
16 duckdb:duckdb -0.7% -5.5% +5.0% +20.3% ➖ noise
16 duckdb:vortex-compact +7.6% -5.5% +13.8% +14.5% ➖ noise
16 duckdb:vortex-file-compressed -4.3% -5.5% +1.2% +10.0% ➖ noise
17 datafusion:vortex-compact -5.3% -5.0% -0.3% +10.0% ➖ noise
17 datafusion:vortex-file-compressed -4.7% -5.0% +0.3% +10.0% ➖ noise
17 duckdb:duckdb -3.3% -5.0% +1.8% +10.0% ➖ noise
17 duckdb:vortex-compact +5.2% -5.0% +10.7% +11.5% ➖ noise
17 duckdb:vortex-file-compressed -5.1% -5.0% -0.1% +12.1% ➖ noise
18 datafusion:vortex-compact -4.1% -3.7% -0.5% +10.0% ➖ noise
18 datafusion:vortex-file-compressed -3.2% -3.7% +0.4% +10.0% ➖ noise
18 duckdb:duckdb -6.3% -3.7% -2.8% +11.5% ➖ noise
18 duckdb:vortex-compact -0.3% -3.7% +3.5% +10.0% ➖ noise
18 duckdb:vortex-file-compressed -2.5% -3.7% +1.2% +10.0% ➖ noise
19 datafusion:vortex-compact -7.9% -2.7% -5.3% +10.0% ➖ noise
19 datafusion:vortex-file-compressed -7.8% -2.7% -5.3% +10.0% ➖ noise
19 duckdb:duckdb -3.1% -2.7% -0.4% +10.2% ➖ noise
19 duckdb:vortex-compact +2.5% -2.7% +5.4% +10.0% ➖ noise
19 duckdb:vortex-file-compressed -6.1% -2.7% -3.5% +14.9% ➖ noise
20 datafusion:vortex-compact -3.6% -4.8% +1.3% +10.0% ➖ noise
20 datafusion:vortex-file-compressed -6.7% -4.8% -2.0% +10.0% ➖ noise
20 duckdb:duckdb -5.8% -4.8% -1.1% +10.4% ➖ noise
20 duckdb:vortex-compact -5.5% -4.8% -0.7% +10.0% ➖ noise
20 duckdb:vortex-file-compressed -6.0% -4.8% -1.3% +10.0% ➖ noise
21 datafusion:vortex-compact -5.6% -5.1% -0.5% +10.0% ➖ noise
21 datafusion:vortex-file-compressed -1.5% -5.1% +3.8% +10.2% ➖ noise
21 duckdb:duckdb -19.9% -5.1% -15.6% +14.3% ✅ faster
21 duckdb:vortex-compact -1.5% -5.1% +3.8% +10.0% ➖ noise
21 duckdb:vortex-file-compressed -0.2% -5.1% +5.2% +17.4% ➖ noise
22 datafusion:vortex-compact -2.4% -8.1% +6.2% +13.3% ➖ noise
22 datafusion:vortex-file-compressed -4.4% -8.1% +4.1% +13.1% ➖ noise
22 duckdb:duckdb -9.4% -8.1% -1.4% +11.3% ➖ noise
22 duckdb:vortex-compact -7.1% -8.1% +1.1% +11.6% ➖ noise
22 duckdb:vortex-file-compressed -5.1% -8.1% +3.3% +11.3% ➖ noise
23 datafusion:vortex-compact +1.4% -7.1% +9.2% +10.0% ➖ noise
23 datafusion:vortex-file-compressed -4.0% -7.1% +3.4% +10.0% ➖ noise
23 duckdb:duckdb -8.5% -7.1% -1.5% +12.8% ➖ noise
23 duckdb:vortex-compact -4.6% -7.1% +2.7% +12.9% ➖ noise
23 duckdb:vortex-file-compressed -8.8% -7.1% -1.9% +10.0% ➖ noise
24 datafusion:vortex-compact -5.8% -4.0% -1.8% +10.0% ➖ noise
24 datafusion:vortex-file-compressed -2.3% -4.0% +1.9% +10.0% ➖ noise
24 duckdb:duckdb -7.8% -4.0% -3.9% +11.5% ➖ noise
24 duckdb:vortex-compact +2.7% -4.0% +7.1% +11.0% ➖ noise
24 duckdb:vortex-file-compressed -7.1% -4.0% -3.2% +11.3% ➖ noise
25 datafusion:vortex-compact -0.1% -2.0% +2.0% +10.0% ➖ noise
25 datafusion:vortex-file-compressed -3.5% -2.0% -1.4% +10.0% ➖ noise
25 duckdb:duckdb -3.5% -2.0% -1.5% +10.0% ➖ noise
25 duckdb:vortex-compact -2.0% -2.0% +0.1% +11.0% ➖ noise
25 duckdb:vortex-file-compressed -5.2% -2.0% -3.3% +10.8% ➖ noise
26 datafusion:vortex-compact -4.4% -5.3% +0.9% +10.5% ➖ noise
26 datafusion:vortex-file-compressed -3.6% -5.3% +1.8% +10.0% ➖ noise
26 duckdb:duckdb +2.1% -5.3% +7.8% +14.0% ➖ noise
26 duckdb:vortex-compact +1.0% -5.3% +6.6% +13.4% ➖ noise
26 duckdb:vortex-file-compressed -7.9% -5.3% -2.7% +11.8% ➖ noise
27 datafusion:vortex-compact -3.0% -5.4% +2.5% +10.0% ➖ noise
27 datafusion:vortex-file-compressed -7.5% -5.4% -2.2% +10.0% ➖ noise
27 duckdb:duckdb -4.8% -5.4% +0.6% +22.0% ➖ noise
27 duckdb:vortex-compact -0.3% -5.4% +5.3% +10.0% ➖ noise
27 duckdb:vortex-file-compressed -1.2% -5.4% +4.4% +10.0% ➖ noise
28 datafusion:vortex-compact -5.0% -2.2% -2.8% +10.0% ➖ noise
28 datafusion:vortex-file-compressed -4.1% -2.2% -1.9% +10.0% ➖ noise
28 duckdb:duckdb -1.2% -2.2% +1.1% +10.0% ➖ noise
28 duckdb:vortex-compact -1.4% -2.2% +0.9% +10.0% ➖ noise
28 duckdb:vortex-file-compressed -2.4% -2.2% -0.1% +10.0% ➖ noise
29 datafusion:vortex-compact -3.9% -2.1% -1.8% +10.0% ➖ noise
29 datafusion:vortex-file-compressed +0.6% -2.1% +2.8% +10.0% ➖ noise
29 duckdb:duckdb -3.1% -2.1% -1.1% +10.6% ➖ noise
29 duckdb:vortex-compact -4.1% -2.1% -2.0% +10.2% ➖ noise
29 duckdb:vortex-file-compressed -7.3% -2.1% -5.3% +12.5% ➖ noise
30 datafusion:vortex-compact -5.1% -7.9% +3.0% +10.0% ➖ noise
30 datafusion:vortex-file-compressed -1.8% -7.9% +6.6% +11.1% ➖ noise
30 duckdb:duckdb -7.6% -7.9% +0.3% +10.1% ➖ noise
30 duckdb:vortex-compact -3.8% -7.9% +4.4% +10.0% ➖ noise
30 duckdb:vortex-file-compressed -0.0% -7.9% +8.5% +11.8% ➖ noise
31 datafusion:vortex-compact -3.5% -0.8% -2.7% +10.0% ➖ noise
31 datafusion:vortex-file-compressed -4.8% -0.8% -4.0% +10.0% ➖ noise
31 duckdb:duckdb -4.0% -0.8% -3.2% +11.0% ➖ noise
31 duckdb:vortex-compact -9.1% -0.8% -8.3% +10.0% ➖ noise
31 duckdb:vortex-file-compressed -11.6% -0.8% -10.8% +10.8% ✅ faster
32 datafusion:vortex-compact -6.0% -1.0% -5.1% +13.2% ➖ noise
32 datafusion:vortex-file-compressed -11.8% -1.0% -11.0% +11.0% ✅ faster
32 duckdb:duckdb -9.9% -1.0% -9.0% +18.1% ➖ noise
32 duckdb:vortex-compact -1.4% -1.0% -0.4% +10.0% ➖ noise
32 duckdb:vortex-file-compressed +0.3% -1.0% +1.2% +17.0% ➖ noise
33 datafusion:vortex-compact -8.5% -5.1% -3.5% +10.0% ➖ noise
33 datafusion:vortex-file-compressed -7.3% -5.1% -2.3% +11.6% ➖ noise
33 duckdb:duckdb -1.5% -5.1% +3.8% +10.6% ➖ noise
33 duckdb:vortex-compact -4.7% -5.1% +0.5% +10.0% ➖ noise
33 duckdb:vortex-file-compressed -6.6% -5.1% -1.5% +15.1% ➖ noise
34 datafusion:vortex-compact -2.0% -3.0% +1.1% +10.0% ➖ noise
34 datafusion:vortex-file-compressed -5.7% -3.0% -2.8% +10.0% ➖ noise
34 duckdb:duckdb -3.8% -3.0% -0.8% +10.1% ➖ noise
34 duckdb:vortex-compact -0.4% -3.0% +2.6% +10.0% ➖ noise
34 duckdb:vortex-file-compressed -1.3% -3.0% +1.8% +11.7% ➖ noise
35 datafusion:vortex-compact -3.8% -5.2% +1.4% +10.0% ➖ noise
35 datafusion:vortex-file-compressed -2.9% -5.2% +2.4% +10.0% ➖ noise
35 duckdb:duckdb +1.1% -5.2% +6.7% +15.6% ➖ noise
35 duckdb:vortex-compact +7.3% -5.2% +13.1% +11.2% 🚨 regression
35 duckdb:vortex-file-compressed -7.1% -5.2% -2.1% +12.0% ➖ noise
36 datafusion:vortex-compact -2.8% -2.2% -0.6% +10.0% ➖ noise
36 datafusion:vortex-file-compressed -2.4% -2.2% -0.2% +10.0% ➖ noise
36 duckdb:duckdb +3.8% -2.2% +6.1% +10.0% ➖ noise
36 duckdb:vortex-compact +3.1% -2.2% +5.4% +10.0% ➖ noise
36 duckdb:vortex-file-compressed -0.1% -2.2% +2.1% +14.6% ➖ noise
37 datafusion:vortex-compact -4.7% -4.0% -0.7% +10.0% ➖ noise
37 datafusion:vortex-file-compressed +5.2% -4.0% +9.6% +13.4% ➖ noise
37 duckdb:duckdb -0.6% -4.0% +3.5% +12.3% ➖ noise
37 duckdb:vortex-compact -1.8% -4.0% +2.3% +13.7% ➖ noise
37 duckdb:vortex-file-compressed -5.8% -4.0% -1.9% +12.3% ➖ noise
38 datafusion:vortex-compact -2.7% -3.1% +0.4% +10.0% ➖ noise
38 datafusion:vortex-file-compressed -3.4% -3.1% -0.3% +10.0% ➖ noise
38 duckdb:duckdb +4.3% -3.1% +7.6% +10.0% ➖ noise
38 duckdb:vortex-compact +3.8% -3.1% +7.2% +14.4% ➖ noise
38 duckdb:vortex-file-compressed -2.0% -3.1% +1.1% +10.0% ➖ noise
39 datafusion:vortex-compact -3.5% +6.5% -9.4% +16.6% ➖ noise
39 datafusion:vortex-file-compressed -10.9% +6.5% -16.4% +21.4% ➖ noise
39 duckdb:duckdb +0.2% +6.5% -5.9% +17.5% ➖ noise
39 duckdb:vortex-compact -3.2% +6.5% -9.2% +14.4% ➖ noise
39 duckdb:vortex-file-compressed -6.8% +6.5% -12.5% +15.6% ➖ noise
40 datafusion:vortex-compact -11.2% -3.0% -8.4% +12.9% ➖ noise
40 datafusion:vortex-file-compressed -6.2% -3.0% -3.3% +13.7% ➖ noise
40 duckdb:duckdb +0.3% -3.0% +3.5% +17.6% ➖ noise
40 duckdb:vortex-compact -5.8% -3.0% -2.9% +15.5% ➖ noise
40 duckdb:vortex-file-compressed -8.2% -3.0% -5.3% +14.6% ➖ noise
41 datafusion:vortex-compact -5.9% -2.9% -3.1% +10.0% ➖ noise
41 datafusion:vortex-file-compressed -16.7% -2.9% -14.2% +15.3% ✅ faster
41 duckdb:duckdb -1.6% -2.9% +1.3% +10.0% ➖ noise
41 duckdb:vortex-compact -3.2% -2.9% -0.3% +10.0% ➖ noise
41 duckdb:vortex-file-compressed -5.8% -2.9% -3.0% +10.0% ➖ noise
42 datafusion:vortex-compact -2.7% -0.6% -2.2% +12.3% ➖ noise
42 datafusion:vortex-file-compressed -7.7% -0.6% -7.1% +10.0% ➖ noise
42 duckdb:duckdb +2.0% -0.6% +2.6% +16.5% ➖ noise
42 duckdb:vortex-compact -0.5% -0.6% +0.0% +17.9% ➖ noise
42 duckdb:vortex-file-compressed +1.8% -0.6% +2.4% +14.4% ➖ noise
43 datafusion:vortex-compact +1.4% -3.9% +5.5% +10.0% ➖ noise
43 datafusion:vortex-file-compressed -5.7% -3.9% -1.9% +10.0% ➖ noise
43 duckdb:duckdb -1.5% -3.9% +2.5% +10.6% ➖ noise
43 duckdb:vortex-compact -4.7% -3.9% -0.9% +10.0% ➖ noise
43 duckdb:vortex-file-compressed -7.6% -3.9% -3.9% +10.0% ➖ noise
44 datafusion:vortex-compact -5.0% +0.6% -5.5% +10.0% ➖ noise
44 datafusion:vortex-file-compressed -2.3% +0.6% -2.9% +10.0% ➖ noise
44 duckdb:duckdb -3.3% +0.6% -3.9% +10.9% ➖ noise
44 duckdb:vortex-compact -0.2% +0.6% -0.8% +10.0% ➖ noise
44 duckdb:vortex-file-compressed -3.7% +0.6% -4.2% +10.3% ➖ noise
45 datafusion:vortex-compact -7.5% +2.4% -9.6% +10.0% ✅ faster
45 datafusion:vortex-file-compressed -3.6% +2.4% -5.8% +10.0% ➖ noise
45 duckdb:duckdb -4.9% +2.4% -7.1% +13.1% ➖ noise
45 duckdb:vortex-compact -6.6% +2.4% -8.8% +10.0% ➖ noise
45 duckdb:vortex-file-compressed -4.5% +2.4% -6.7% +15.6% ➖ noise
46 datafusion:vortex-compact -2.7% -1.1% -1.6% +10.0% ➖ noise
46 datafusion:vortex-file-compressed -7.0% -1.1% -5.9% +10.0% ➖ noise
46 duckdb:duckdb -0.7% -1.1% +0.5% +10.0% ➖ noise
46 duckdb:vortex-compact -0.3% -1.1% +0.8% +10.0% ➖ noise
46 duckdb:vortex-file-compressed -1.9% -1.1% -0.8% +10.0% ➖ noise
47 datafusion:vortex-compact -2.9% -2.8% -0.1% +10.0% ➖ noise
47 datafusion:vortex-file-compressed -5.4% -2.8% -2.6% +10.0% ➖ noise
47 duckdb:duckdb +0.3% -2.8% +3.3% +15.7% ➖ noise
47 duckdb:vortex-compact -4.8% -2.8% -2.1% +10.0% ➖ noise
47 duckdb:vortex-file-compressed -2.6% -2.8% +0.3% +10.0% ➖ noise
48 datafusion:vortex-compact -3.7% -0.2% -3.6% +10.0% ➖ noise
48 datafusion:vortex-file-compressed -4.4% -0.2% -4.2% +10.0% ➖ noise
48 duckdb:duckdb -8.4% -0.2% -8.3% +11.2% ➖ noise
48 duckdb:vortex-compact +1.2% -0.2% +1.4% +10.0% ➖ noise
48 duckdb:vortex-file-compressed -2.2% -0.2% -2.0% +10.3% ➖ noise
49 datafusion:vortex-compact -6.2% -1.7% -4.6% +13.6% ➖ noise
49 datafusion:vortex-file-compressed -9.9% -1.7% -8.3% +14.7% ➖ noise
49 duckdb:duckdb -7.0% -1.7% -5.5% +15.8% ➖ noise
49 duckdb:vortex-compact +2.8% -1.7% +4.5% +13.7% ➖ noise
49 duckdb:vortex-file-compressed -11.2% -1.7% -9.7% +20.1% ➖ noise
50 datafusion:vortex-compact -2.6% -1.0% -1.6% +10.0% ➖ noise
50 datafusion:vortex-file-compressed -3.6% -1.0% -2.6% +10.0% ➖ noise
50 duckdb:duckdb -5.8% -1.0% -4.9% +10.0% ➖ noise
50 duckdb:vortex-compact -4.3% -1.0% -3.3% +10.0% ➖ noise
50 duckdb:vortex-file-compressed -4.8% -1.0% -3.9% +10.0% ➖ noise
51 datafusion:vortex-compact -7.3% -7.7% +0.5% +10.2% ➖ noise
51 datafusion:vortex-file-compressed -1.6% -7.7% +6.6% +14.4% ➖ noise
51 duckdb:duckdb -3.0% -7.7% +5.0% +17.1% ➖ noise
51 duckdb:vortex-compact -0.5% -7.7% +7.8% +12.8% ➖ noise
51 duckdb:vortex-file-compressed -7.5% -7.7% +0.2% +22.4% ➖ noise
52 datafusion:vortex-compact -1.6% -8.5% +7.6% +12.5% ➖ noise
52 datafusion:vortex-file-compressed -0.1% -8.5% +9.2% +10.1% ➖ noise
52 duckdb:duckdb -0.5% -8.5% +8.8% +18.2% ➖ noise
52 duckdb:vortex-compact -4.7% -8.5% +4.2% +15.2% ➖ noise
52 duckdb:vortex-file-compressed -12.1% -8.5% -3.9% +17.5% ➖ noise
53 datafusion:vortex-compact -7.0% -0.9% -6.1% +10.7% ➖ noise
53 datafusion:vortex-file-compressed -2.8% -0.9% -1.9% +10.0% ➖ noise
53 duckdb:duckdb -3.2% -0.9% -2.3% +13.2% ➖ noise
53 duckdb:vortex-compact -6.3% -0.9% -5.4% +10.8% ➖ noise
53 duckdb:vortex-file-compressed -10.8% -0.9% -10.0% +10.0% ✅ faster
54 datafusion:vortex-compact -6.5% -0.1% -6.4% +10.0% ➖ noise
54 datafusion:vortex-file-compressed -6.2% -0.1% -6.1% +10.0% ➖ noise
54 duckdb:duckdb +1.2% -0.1% +1.3% +11.5% ➖ noise
54 duckdb:vortex-compact -3.3% -0.1% -3.2% +10.0% ➖ noise
54 duckdb:vortex-file-compressed -4.7% -0.1% -4.6% +10.0% ➖ noise
55 datafusion:vortex-compact -3.5% -3.5% -0.1% +13.5% ➖ noise
55 datafusion:vortex-file-compressed -3.6% -3.5% -0.2% +13.9% ➖ noise
55 duckdb:duckdb -3.1% -3.5% +0.4% +18.7% ➖ noise
55 duckdb:vortex-compact -5.8% -3.5% -2.4% +16.0% ➖ noise
55 duckdb:vortex-file-compressed +1.1% -3.5% +4.8% +20.5% ➖ noise
56 datafusion:vortex-compact -4.9% -2.3% -2.7% +10.0% ➖ noise
56 datafusion:vortex-file-compressed -0.3% -2.3% +2.0% +10.0% ➖ noise
56 duckdb:duckdb -4.7% -2.3% -2.5% +11.6% ➖ noise
56 duckdb:vortex-compact -4.0% -2.3% -1.8% +10.0% ➖ noise
56 duckdb:vortex-file-compressed -0.7% -2.3% +1.6% +10.0% ➖ noise
57 datafusion:vortex-compact -3.4% -4.7% +1.4% +10.0% ➖ noise
57 datafusion:vortex-file-compressed -7.4% -4.7% -2.8% +10.0% ➖ noise
57 duckdb:duckdb +9.6% -4.7% +15.1% +13.4% 🚨 regression
57 duckdb:vortex-compact -4.0% -4.7% +0.8% +26.9% ➖ noise
57 duckdb:vortex-file-compressed -6.6% -4.7% -1.9% +11.5% ➖ noise
58 datafusion:vortex-compact -7.1% -3.2% -4.1% +10.0% ➖ noise
58 datafusion:vortex-file-compressed -6.3% -3.2% -3.2% +10.0% ➖ noise
58 duckdb:duckdb -8.7% -3.2% -5.7% +17.0% ➖ noise
58 duckdb:vortex-compact -6.4% -3.2% -3.4% +14.2% ➖ noise
58 duckdb:vortex-file-compressed -7.8% -3.2% -4.8% +14.1% ➖ noise
59 datafusion:vortex-compact -3.8% +0.6% -4.3% +10.0% ➖ noise
59 datafusion:vortex-file-compressed -4.1% +0.6% -4.7% +10.0% ➖ noise
59 duckdb:duckdb +2.4% +0.6% +1.8% +10.0% ➖ noise
59 duckdb:vortex-compact +5.1% +0.6% +4.5% +10.0% ➖ noise
59 duckdb:vortex-file-compressed -5.1% +0.6% -5.6% +10.0% ➖ noise
60 datafusion:vortex-compact -5.6% -0.3% -5.4% +10.0% ➖ noise
60 datafusion:vortex-file-compressed -1.1% -0.3% -0.8% +10.0% ➖ noise
60 duckdb:duckdb +2.7% -0.3% +3.0% +19.6% ➖ noise
60 duckdb:vortex-compact -6.6% -0.3% -6.4% +10.0% ➖ noise
60 duckdb:vortex-file-compressed -2.2% -0.3% -2.0% +11.0% ➖ noise
61 datafusion:vortex-compact -4.6% -1.3% -3.3% +10.0% ➖ noise
61 datafusion:vortex-file-compressed -0.1% -1.3% +1.2% +10.0% ➖ noise
61 duckdb:duckdb +1.1% -1.3% +2.5% +10.0% ➖ noise
61 duckdb:vortex-compact -4.4% -1.3% -3.1% +10.0% ➖ noise
61 duckdb:vortex-file-compressed +0.4% -1.3% +1.7% +10.1% ➖ noise
62 datafusion:vortex-compact -6.1% +0.4% -6.4% +12.6% ➖ noise
62 datafusion:vortex-file-compressed -5.8% +0.4% -6.1% +12.6% ➖ noise
62 duckdb:duckdb +3.1% +0.4% +2.7% +14.1% ➖ noise
62 duckdb:vortex-compact -3.9% +0.4% -4.3% +29.1% ➖ noise
62 duckdb:vortex-file-compressed -15.9% +0.4% -16.2% +17.0% ✅ faster
63 datafusion:vortex-compact -5.8% -4.1% -1.7% +10.0% ➖ noise
63 datafusion:vortex-file-compressed -1.4% -4.1% +2.8% +10.0% ➖ noise
63 duckdb:duckdb -0.1% -4.1% +4.2% +10.0% ➖ noise
63 duckdb:vortex-compact -6.5% -4.1% -2.5% +10.6% ➖ noise
63 duckdb:vortex-file-compressed -0.0% -4.1% +4.3% +10.4% ➖ noise
64 datafusion:vortex-compact -4.7% -3.0% -1.7% +10.0% ➖ noise
64 datafusion:vortex-file-compressed -6.4% -3.0% -3.5% +10.0% ➖ noise
64 duckdb:duckdb -4.3% -3.0% -1.3% +10.0% ➖ noise
64 duckdb:vortex-compact -5.2% -3.0% -2.3% +10.0% ➖ noise
64 duckdb:vortex-file-compressed -8.5% -3.0% -5.6% +10.0% ➖ noise
65 datafusion:vortex-compact -1.8% -4.7% +3.0% +12.7% ➖ noise
65 datafusion:vortex-file-compressed -1.3% -4.7% +3.5% +14.8% ➖ noise
65 duckdb:duckdb +1.0% -4.7% +5.9% +15.3% ➖ noise
65 duckdb:vortex-compact -6.1% -4.7% -1.5% +11.9% ➖ noise
65 duckdb:vortex-file-compressed -0.8% -4.7% +4.1% +11.2% ➖ noise
66 datafusion:vortex-compact -4.1% -6.1% +2.2% +12.6% ➖ noise
66 datafusion:vortex-file-compressed -3.2% -6.1% +3.1% +13.4% ➖ noise
66 duckdb:duckdb +1.7% -6.1% +8.3% +12.7% ➖ noise
66 duckdb:vortex-compact -2.8% -6.1% +3.5% +14.6% ➖ noise
66 duckdb:vortex-file-compressed -4.1% -6.1% +2.2% +12.5% ➖ noise
67 datafusion:vortex-compact -5.7% -2.0% -3.7% +10.0% ➖ noise
67 datafusion:vortex-file-compressed -4.4% -2.0% -2.4% +10.0% ➖ noise
67 duckdb:duckdb -5.0% -2.0% -3.0% +10.0% ➖ noise
67 duckdb:vortex-compact -0.6% -2.0% +1.5% +10.0% ➖ noise
67 duckdb:vortex-file-compressed -2.9% -2.0% -0.9% +10.0% ➖ noise
68 datafusion:vortex-compact -3.6% -0.8% -2.8% +10.1% ➖ noise
68 datafusion:vortex-file-compressed -0.8% -0.8% -0.0% +10.0% ➖ noise
68 duckdb:duckdb -1.5% -0.8% -0.6% +10.9% ➖ noise
68 duckdb:vortex-compact -2.4% -0.8% -1.6% +10.0% ➖ noise
68 duckdb:vortex-file-compressed +0.1% -0.8% +0.9% +10.0% ➖ noise
69 datafusion:vortex-compact -2.9% -3.0% +0.1% +10.0% ➖ noise
69 datafusion:vortex-file-compressed -4.2% -3.0% -1.2% +10.0% ➖ noise
69 duckdb:duckdb +3.7% -3.0% +6.9% +14.2% ➖ noise
69 duckdb:vortex-compact -7.1% -3.0% -4.2% +13.9% ➖ noise
69 duckdb:vortex-file-compressed -4.8% -3.0% -1.8% +10.0% ➖ noise
70 datafusion:vortex-compact -0.7% -4.6% +4.0% +10.0% ➖ noise
70 datafusion:vortex-file-compressed -3.1% -4.6% +1.5% +10.0% ➖ noise
70 duckdb:duckdb +12.7% -4.6% +18.0% +14.0% 🚨 regression
70 duckdb:vortex-compact -2.5% -4.6% +2.2% +10.0% ➖ noise
70 duckdb:vortex-file-compressed +1.0% -4.6% +5.9% +10.6% ➖ noise
71 datafusion:vortex-compact -4.1% -1.8% -2.4% +10.0% ➖ noise
71 datafusion:vortex-file-compressed -2.3% -1.8% -0.5% +10.0% ➖ noise
71 duckdb:duckdb +10.5% -1.8% +12.6% +14.2% ➖ noise
71 duckdb:vortex-compact -7.7% -1.8% -6.0% +10.0% ➖ noise
71 duckdb:vortex-file-compressed -7.6% -1.8% -5.9% +13.8% ➖ noise
72 datafusion:vortex-compact -7.9% -2.4% -5.6% +10.0% ➖ noise
72 datafusion:vortex-file-compressed -8.2% -2.4% -5.9% +10.0% ➖ noise
72 duckdb:duckdb +0.2% -2.4% +2.7% +10.0% ➖ noise
72 duckdb:vortex-compact -3.7% -2.4% -1.3% +10.0% ➖ noise
72 duckdb:vortex-file-compressed -2.4% -2.4% +0.0% +10.0% ➖ noise
73 datafusion:vortex-compact +2.5% -7.4% +10.7% +12.6% ➖ noise
73 datafusion:vortex-file-compressed -4.5% -7.4% +3.1% +14.4% ➖ noise
73 duckdb:duckdb +8.0% -7.4% +16.6% +13.5% 🚨 regression
73 duckdb:vortex-compact +5.6% -7.4% +14.0% +10.0% 🚨 regression
73 duckdb:vortex-file-compressed -7.8% -7.4% -0.5% +10.0% ➖ noise
74 datafusion:vortex-compact -4.6% -1.3% -3.3% +10.0% ➖ noise
74 datafusion:vortex-file-compressed -5.0% -1.3% -3.8% +10.0% ➖ noise
74 duckdb:duckdb -2.1% -1.3% -0.9% +17.1% ➖ noise
74 duckdb:vortex-compact -0.0% -1.3% +1.3% +10.0% ➖ noise
74 duckdb:vortex-file-compressed -2.9% -1.3% -1.7% +10.0% ➖ noise
75 datafusion:vortex-compact -5.5% -5.1% -0.4% +10.0% ➖ noise
75 datafusion:vortex-file-compressed -6.8% -5.1% -1.8% +10.0% ➖ noise
75 duckdb:duckdb -1.8% -5.1% +3.5% +10.9% ➖ noise
75 duckdb:vortex-compact -9.2% -5.1% -4.3% +12.3% ➖ noise
75 duckdb:vortex-file-compressed -11.2% -5.1% -6.4% +10.0% ➖ noise
76 datafusion:vortex-compact +1.8% -5.3% +7.4% +11.1% ➖ noise
76 datafusion:vortex-file-compressed -0.4% -5.3% +5.2% +10.0% ➖ noise
76 duckdb:duckdb -4.6% -5.3% +0.7% +16.3% ➖ noise
76 duckdb:vortex-compact -9.7% -5.3% -4.7% +16.1% ➖ noise
76 duckdb:vortex-file-compressed -1.2% -5.3% +4.3% +18.9% ➖ noise
77 datafusion:vortex-compact -3.4% -1.9% -1.6% +10.0% ➖ noise
77 datafusion:vortex-file-compressed -5.9% -1.9% -4.1% +10.0% ➖ noise
77 duckdb:duckdb -7.6% -1.9% -5.9% +10.8% ➖ noise
77 duckdb:vortex-compact -0.4% -1.9% +1.5% +10.0% ➖ noise
77 duckdb:vortex-file-compressed -8.2% -1.9% -6.5% +13.2% ➖ noise
78 datafusion:vortex-compact -6.0% -3.8% -2.3% +10.0% ➖ noise
78 datafusion:vortex-file-compressed -5.9% -3.8% -2.1% +10.0% ➖ noise
78 duckdb:duckdb -4.3% -3.8% -0.5% +11.3% ➖ noise
78 duckdb:vortex-compact -3.3% -3.8% +0.6% +10.0% ➖ noise
78 duckdb:vortex-file-compressed -6.0% -3.8% -2.3% +10.0% ➖ noise
79 datafusion:vortex-compact -4.1% -3.6% -0.5% +10.0% ➖ noise
79 datafusion:vortex-file-compressed -3.4% -3.6% +0.2% +10.0% ➖ noise
79 duckdb:duckdb -4.5% -3.6% -0.9% +12.2% ➖ noise
79 duckdb:vortex-compact -5.6% -3.6% -2.0% +10.5% ➖ noise
79 duckdb:vortex-file-compressed -6.4% -3.6% -2.9% +11.0% ➖ noise
80 datafusion:vortex-compact -5.4% -8.9% +3.8% +10.0% ➖ noise
80 datafusion:vortex-file-compressed -3.8% -8.9% +5.6% +10.2% ➖ noise
80 duckdb:duckdb -8.2% -8.9% +0.8% +13.6% ➖ noise
80 duckdb:vortex-compact -0.2% -8.9% +9.5% +10.0% ➖ noise
80 duckdb:vortex-file-compressed -13.7% -8.9% -5.3% +10.0% ➖ noise
81 datafusion:vortex-compact -5.8% -3.0% -2.9% +10.6% ➖ noise
81 datafusion:vortex-file-compressed -11.4% -3.0% -8.7% +10.0% ➖ noise
81 duckdb:duckdb -4.2% -3.0% -1.3% +10.0% ➖ noise
81 duckdb:vortex-compact -5.8% -3.0% -2.9% +10.0% ➖ noise
81 duckdb:vortex-file-compressed -3.2% -3.0% -0.2% +10.0% ➖ noise
82 datafusion:vortex-compact -8.1% -2.2% -6.0% +10.7% ➖ noise
82 datafusion:vortex-file-compressed -7.1% -2.2% -5.0% +10.0% ➖ noise
82 duckdb:duckdb -11.9% -2.2% -9.9% +19.4% ➖ noise
82 duckdb:vortex-compact -1.5% -2.2% +0.7% +10.4% ➖ noise
82 duckdb:vortex-file-compressed -2.6% -2.2% -0.4% +12.8% ➖ noise
83 datafusion:vortex-compact -5.2% -5.7% +0.5% +10.0% ➖ noise
83 datafusion:vortex-file-compressed -2.3% -5.7% +3.6% +10.0% ➖ noise
83 duckdb:duckdb -0.4% -5.7% +5.5% +12.4% ➖ noise
83 duckdb:vortex-compact -2.1% -5.7% +3.7% +10.3% ➖ noise
83 duckdb:vortex-file-compressed -14.5% -5.7% -9.3% +10.6% ➖ noise
84 datafusion:vortex-compact -18.6% -4.3% -15.0% +11.9% ✅ faster
84 datafusion:vortex-file-compressed -5.6% -4.3% -1.4% +18.4% ➖ noise
84 duckdb:duckdb +0.4% -4.3% +4.9% +13.9% ➖ noise
84 duckdb:vortex-compact -7.1% -4.3% -2.9% +10.0% ➖ noise
84 duckdb:vortex-file-compressed -5.2% -4.3% -1.0% +10.0% ➖ noise
85 datafusion:vortex-compact -1.2% -4.5% +3.5% +10.0% ➖ noise
85 datafusion:vortex-file-compressed +0.3% -4.5% +5.1% +10.0% ➖ noise
85 duckdb:duckdb -6.3% -4.5% -1.9% +11.9% ➖ noise
85 duckdb:vortex-compact -3.0% -4.5% +1.6% +10.0% ➖ noise
85 duckdb:vortex-file-compressed +0.3% -4.5% +5.0% +10.8% ➖ noise
86 datafusion:vortex-compact -4.5% -1.1% -3.5% +10.0% ➖ noise
86 datafusion:vortex-file-compressed -4.2% -1.1% -3.2% +10.0% ➖ noise
86 duckdb:duckdb +3.2% -1.1% +4.3% +10.0% ➖ noise
86 duckdb:vortex-compact -8.1% -1.1% -7.1% +20.6% ➖ noise
86 duckdb:vortex-file-compressed +0.7% -1.1% +1.8% +11.8% ➖ noise
87 datafusion:vortex-compact -4.4% -1.6% -2.9% +10.0% ➖ noise
87 datafusion:vortex-file-compressed -1.2% -1.6% +0.3% +10.0% ➖ noise
87 duckdb:duckdb +16.0% -1.6% +17.8% +13.0% 🚨 regression
87 duckdb:vortex-compact +1.7% -1.6% +3.3% +15.4% ➖ noise
87 duckdb:vortex-file-compressed -2.9% -1.6% -1.3% +11.9% ➖ noise
88 datafusion:vortex-compact -3.2% -2.2% -1.0% +10.0% ➖ noise
88 datafusion:vortex-file-compressed -3.6% -2.2% -1.4% +10.0% ➖ noise
88 duckdb:duckdb +2.2% -2.2% +4.5% +10.0% ➖ noise
88 duckdb:vortex-compact -9.3% -2.2% -7.2% +10.0% ➖ noise
88 duckdb:vortex-file-compressed -8.8% -2.2% -6.8% +10.0% ➖ noise
89 datafusion:vortex-compact -6.2% -4.1% -2.2% +10.0% ➖ noise
89 datafusion:vortex-file-compressed -6.2% -4.1% -2.2% +10.0% ➖ noise
89 duckdb:duckdb +0.7% -4.1% +4.9% +10.4% ➖ noise
89 duckdb:vortex-compact -3.0% -4.1% +1.1% +11.2% ➖ noise
89 duckdb:vortex-file-compressed -3.3% -4.1% +0.8% +16.2% ➖ noise
90 datafusion:vortex-compact -4.1% +0.2% -4.3% +10.0% ➖ noise
90 datafusion:vortex-file-compressed -6.8% +0.2% -7.0% +10.0% ➖ noise
90 duckdb:duckdb +5.4% +0.2% +5.2% +10.0% ➖ noise
90 duckdb:vortex-compact +2.1% +0.2% +1.9% +10.2% ➖ noise
90 duckdb:vortex-file-compressed -6.4% +0.2% -6.6% +12.5% ➖ noise
91 datafusion:vortex-compact -4.1% +0.1% -4.2% +10.0% ➖ noise
91 datafusion:vortex-file-compressed -5.9% +0.1% -5.9% +10.0% ➖ noise
91 duckdb:duckdb +10.0% +0.1% +10.0% +16.1% ➖ noise
91 duckdb:vortex-compact -2.9% +0.1% -2.9% +10.0% ➖ noise
91 duckdb:vortex-file-compressed -7.7% +0.1% -7.8% +11.5% ➖ noise
92 datafusion:vortex-compact -6.5% -11.4% +5.5% +10.0% ➖ noise
92 datafusion:vortex-file-compressed -9.2% -11.4% +2.4% +10.0% ➖ noise
92 duckdb:duckdb -5.6% -11.4% +6.5% +10.0% ➖ noise
92 duckdb:vortex-compact -0.8% -11.4% +11.9% +10.4% 🚨 regression
92 duckdb:vortex-file-compressed -9.1% -11.4% +2.6% +11.3% ➖ noise
93 datafusion:vortex-compact -5.4% -2.5% -3.0% +10.6% ➖ noise
93 datafusion:vortex-file-compressed -2.7% -2.5% -0.2% +10.0% ➖ noise
93 duckdb:duckdb -12.1% -2.5% -9.9% +14.4% ➖ noise
93 duckdb:vortex-compact -6.1% -2.5% -3.7% +10.2% ➖ noise
93 duckdb:vortex-file-compressed -3.6% -2.5% -1.2% +15.4% ➖ noise
94 datafusion:vortex-compact -2.2% -3.0% +0.8% +10.0% ➖ noise
94 datafusion:vortex-file-compressed -7.8% -3.0% -4.9% +10.0% ➖ noise
94 duckdb:duckdb -5.5% -3.0% -2.5% +13.3% ➖ noise
94 duckdb:vortex-compact -5.1% -3.0% -2.1% +12.0% ➖ noise
94 duckdb:vortex-file-compressed -15.4% -3.0% -12.8% +12.0% ✅ faster
95 datafusion:vortex-compact -1.9% +0.9% -2.8% +11.2% ➖ noise
95 datafusion:vortex-file-compressed -7.0% +0.9% -7.8% +10.0% ➖ noise
95 duckdb:duckdb -2.5% +0.9% -3.3% +14.7% ➖ noise
95 duckdb:vortex-compact -3.2% +0.9% -4.1% +13.9% ➖ noise
95 duckdb:vortex-file-compressed -7.0% +0.9% -7.8% +15.5% ➖ noise
96 datafusion:vortex-compact -5.6% -10.7% +5.7% +10.8% ➖ noise
96 datafusion:vortex-file-compressed -5.7% -10.7% +5.5% +11.2% ➖ noise
96 duckdb:duckdb -3.6% -10.7% +7.9% +16.5% ➖ noise
96 duckdb:vortex-compact +4.4% -10.7% +16.9% +24.0% ➖ noise
96 duckdb:vortex-file-compressed -4.9% -10.7% +6.4% +23.4% ➖ noise
97 datafusion:vortex-compact -3.0% -4.6% +1.6% +10.0% ➖ noise
97 datafusion:vortex-file-compressed -12.8% -4.6% -8.6% +10.0% ➖ noise
97 duckdb:duckdb +1.6% -4.6% +6.5% +13.2% ➖ noise
97 duckdb:vortex-compact -13.6% -4.6% -9.4% +12.0% ➖ noise
97 duckdb:vortex-file-compressed -2.6% -4.6% +2.1% +10.0% ➖ noise
98 datafusion:vortex-compact -9.8% -3.3% -6.7% +10.0% ➖ noise
98 datafusion:vortex-file-compressed -6.0% -3.3% -2.8% +10.0% ➖ noise
98 duckdb:duckdb -4.4% -3.3% -1.1% +14.1% ➖ noise
98 duckdb:vortex-compact -3.7% -3.3% -0.4% +10.0% ➖ noise
98 duckdb:vortex-file-compressed -5.8% -3.3% -2.6% +12.2% ➖ noise
99 datafusion:vortex-compact +1.3% +6.6% -4.9% +15.2% ➖ noise
99 datafusion:vortex-file-compressed -9.4% +6.6% -15.0% +15.2% ✅ faster
99 duckdb:duckdb -2.9% +6.6% -8.9% +14.0% ➖ noise
99 duckdb:vortex-compact -0.6% +6.6% -6.7% +22.2% ➖ noise
99 duckdb:vortex-file-compressed -2.7% +6.6% -8.7% +17.5% ➖ noise

@github-actions
Copy link
Contributor

github-actions bot commented Mar 18, 2026 •
edited
Loading

Benchmarks: TPC-H SF=10 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.8%
Vortex (geomean): 1.007x ➖
Parquet (geomean): 1.015x ➖
Shifts: Parquet (control) +1.5% · Median polish +1.1%

datafusion / vortex-file-compressed (1.009x ➖, 0↑ 0↓)
name PR 5881376 (ns) base 8efe1dc (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 427469153 444955826 0.96
tpch_q02/datafusion:vortex-file-compressed 163347160 157140686 1.04
tpch_q03/datafusion:vortex-file-compressed 256096813 249918957 1.02
tpch_q04/datafusion:vortex-file-compressed 109328631 107169503 1.02
tpch_q05/datafusion:vortex-file-compressed 468633169 459054485 1.02
tpch_q06/datafusion:vortex-file-compressed 40555549 40790092 0.99
tpch_q07/datafusion:vortex-file-compressed 656107608 648189948 1.01
tpch_q08/datafusion:vortex-file-compressed 468875873 465055786 1.01
tpch_q09/datafusion:vortex-file-compressed 807294126 808937920 1.00
tpch_q10/datafusion:vortex-file-compressed 290974816 286350095 1.02
tpch_q11/datafusion:vortex-file-compressed 115256758 117257839 0.98
tpch_q12/datafusion:vortex-file-compressed 129351628 127526823 1.01
tpch_q13/datafusion:vortex-file-compressed 230715264 225530508 1.02
tpch_q14/datafusion:vortex-file-compressed 73438862 71754519 1.02
tpch_q15/datafusion:vortex-file-compressed 110434741 108829447 1.01
tpch_q16/datafusion:vortex-file-compressed 94416547 93698468 1.01
tpch_q17/datafusion:vortex-file-compressed 762674624 743778518 1.03
tpch_q18/datafusion:vortex-file-compressed 983313119 967049833 1.02
tpch_q19/datafusion:vortex-file-compressed 130696545 131859377 0.99
tpch_q20/datafusion:vortex-file-compressed 203486043 200406244 1.02
tpch_q21/datafusion:vortex-file-compressed 772216477 762899176 1.01
tpch_q22/datafusion:vortex-file-compressed 60721497 62614020 0.97
datafusion / vortex-compact (1.007x ➖, 0↑ 0↓)
name PR 5881376 (ns) base 8efe1dc (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 467984711 478888741 0.98
tpch_q02/datafusion:vortex-compact 164739435 165421824 1.00
tpch_q03/datafusion:vortex-compact 267587930 267224994 1.00
tpch_q04/datafusion:vortex-compact 129022027 125498115 1.03
tpch_q05/datafusion:vortex-compact 474056583 470076870 1.01
tpch_q06/datafusion:vortex-compact 63897451 63018495 1.01
tpch_q07/datafusion:vortex-compact 684969312 672703560 1.02
tpch_q08/datafusion:vortex-compact 482662243 475738508 1.01
tpch_q09/datafusion:vortex-compact 827597265 825696781 1.00
tpch_q10/datafusion:vortex-compact 330816471 327041334 1.01
tpch_q11/datafusion:vortex-compact 123258655 125025202 0.99
tpch_q12/datafusion:vortex-compact 184851894 186723980 0.99
tpch_q13/datafusion:vortex-compact 279744208 275243958 1.02
tpch_q14/datafusion:vortex-compact 89866924 89129559 1.01
tpch_q15/datafusion:vortex-compact 170782175 165758690 1.03
tpch_q16/datafusion:vortex-compact 100209338 99406439 1.01
tpch_q17/datafusion:vortex-compact 754181135 740021574 1.02
tpch_q18/datafusion:vortex-compact 992393207 981289763 1.01
tpch_q19/datafusion:vortex-compact 230824137 231955393 1.00
tpch_q20/datafusion:vortex-compact 230942010 230521599 1.00
tpch_q21/datafusion:vortex-compact 812383602 806071260 1.01
tpch_q22/datafusion:vortex-compact 72580150 71358168 1.02
datafusion / parquet (1.018x ➖, 0↑ 1↓)
name PR 5881376 (ns) base 8efe1dc (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 🚨 496131885 449751652 1.10
tpch_q02/datafusion:parquet 260536601 257348941 1.01
tpch_q03/datafusion:parquet 393942248 395767150 1.00
tpch_q04/datafusion:parquet 150607947 151512498 0.99
tpch_q05/datafusion:parquet 582528356 580386833 1.00
tpch_q06/datafusion:parquet 124564380 124801877 1.00
tpch_q07/datafusion:parquet 806777460 788135124 1.02
tpch_q08/datafusion:parquet 649928565 645806623 1.01
tpch_q09/datafusion:parquet 967232294 956248814 1.01
tpch_q10/datafusion:parquet 606289754 598107006 1.01
tpch_q11/datafusion:parquet 201216955 190112720 1.06
tpch_q12/datafusion:parquet 248979321 248866013 1.00
tpch_q13/datafusion:parquet 344982861 340683419 1.01
tpch_q14/datafusion:parquet 202808463 202080731 1.00
tpch_q15/datafusion:parquet 267341960 257406224 1.04
tpch_q16/datafusion:parquet 188463647 184542885 1.02
tpch_q17/datafusion:parquet 868623252 840881622 1.03
tpch_q18/datafusion:parquet 1044440067 1018465199 1.03
tpch_q19/datafusion:parquet 342009999 329066665 1.04
tpch_q20/datafusion:parquet 375045317 373648319 1.00
tpch_q21/datafusion:parquet 900280342 888790838 1.01
tpch_q22/datafusion:parquet 221593546 222110849 1.00
datafusion / arrow (1.018x ➖, 0↑ 0↓)
name PR 5881376 (ns) base 8efe1dc (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 733847913 736000521 1.00
tpch_q02/datafusion:arrow 207096706 195320921 1.06
tpch_q03/datafusion:arrow 555588548 546312286 1.02
tpch_q04/datafusion:arrow 406665655 387691274 1.05
tpch_q05/datafusion:arrow 1086835170 1046455342 1.04
tpch_q06/datafusion:arrow 322248069 316330977 1.02
tpch_q07/datafusion:arrow 1383453377 1355492904 1.02
tpch_q08/datafusion:arrow 1314922173 1304084291 1.01
tpch_q09/datafusion:arrow 1586613153 1546321644 1.03
tpch_q10/datafusion:arrow 684236249 666957191 1.03
tpch_q11/datafusion:arrow 181484080 174862521 1.04
tpch_q12/datafusion:arrow 738544277 760408019 0.97
tpch_q13/datafusion:arrow 546237607 532112399 1.03
tpch_q14/datafusion:arrow 365792851 356035268 1.03
tpch_q15/datafusion:arrow 771160104 773211650 1.00
tpch_q16/datafusion:arrow 120845730 126789782 0.95
tpch_q17/datafusion:arrow 1598405948 1569230925 1.02
tpch_q18/datafusion:arrow 2166423437 2095024146 1.03
tpch_q19/datafusion:arrow 590102510 579138241 1.02
tpch_q20/datafusion:arrow 572371106 558950656 1.02
tpch_q21/datafusion:arrow 3966831214 3912612034 1.01
tpch_q22/datafusion:arrow 179878501 178679301 1.01
duckdb / vortex-file-compressed (1.006x ➖, 0↑ 0↓)
name PR 5881376 (ns) base 8efe1dc (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 181767683 178367109 1.02
tpch_q02/duckdb:vortex-file-compressed 52149635 55057660 0.95
tpch_q03/duckdb:vortex-file-compressed 129741520 130359220 1.00
tpch_q04/duckdb:vortex-file-compressed 148488481 149873367 0.99
tpch_q05/duckdb:vortex-file-compressed 131663424 132103245 1.00
tpch_q06/duckdb:vortex-file-compressed 49617308 48051777 1.03
tpch_q07/duckdb:vortex-file-compressed 148568022 146939221 1.01
tpch_q08/duckdb:vortex-file-compressed 176559569 176194716 1.00
tpch_q09/duckdb:vortex-file-compressed 337911548 338691326 1.00
tpch_q10/duckdb:vortex-file-compressed 157484931 154005627 1.02
tpch_q11/duckdb:vortex-file-compressed 36011484 37231324 0.97
tpch_q12/duckdb:vortex-file-compressed 97611315 96044283 1.02
tpch_q13/duckdb:vortex-file-compressed 249978113 244717779 1.02
tpch_q14/duckdb:vortex-file-compressed 70307738 69230295 1.02
tpch_q15/duckdb:vortex-file-compressed 100256392 96803310 1.04
tpch_q16/duckdb:vortex-file-compressed 80349715 77890140 1.03
tpch_q17/duckdb:vortex-file-compressed 104369540 103332802 1.01
tpch_q18/duckdb:vortex-file-compressed 271842281 277076884 0.98
tpch_q19/duckdb:vortex-file-compressed 91213605 92422825 0.99
tpch_q20/duckdb:vortex-file-compressed 165905011 163416975 1.02
tpch_q21/duckdb:vortex-file-compressed 555748618 553842187 1.00
tpch_q22/duckdb:vortex-file-compressed 78538865 76293644 1.03
duckdb / vortex-compact (1.007x ➖, 0↑ 0↓)
name PR 5881376 (ns) base 8efe1dc (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 235110353 228353559 1.03
tpch_q02/duckdb:vortex-compact 60221892 59605967 1.01
tpch_q03/duckdb:vortex-compact 140585962 141891030 0.99
tpch_q04/duckdb:vortex-compact 174645911 178168003 0.98
tpch_q05/duckdb:vortex-compact 149619032 149065707 1.00
tpch_q06/duckdb:vortex-compact 86665049 85004420 1.02
tpch_q07/duckdb:vortex-compact 207053757 206810130 1.00
tpch_q08/duckdb:vortex-compact 194857530 194399850 1.00
tpch_q09/duckdb:vortex-compact 365638613 363376152 1.01
tpch_q10/duckdb:vortex-compact 190570528 188572315 1.01
tpch_q11/duckdb:vortex-compact 42764077 42379120 1.01
tpch_q12/duckdb:vortex-compact 211701114 207488171 1.02
tpch_q13/duckdb:vortex-compact 300132469 294312273 1.02
tpch_q14/duckdb:vortex-compact 102896790 104219465 0.99
tpch_q15/duckdb:vortex-compact 121848223 120347860 1.01
tpch_q16/duckdb:vortex-compact 87126386 85941968 1.01
tpch_q17/duckdb:vortex-compact 118331056 116200128 1.02
tpch_q18/duckdb:vortex-compact 289613745 290714213 1.00
tpch_q19/duckdb:vortex-compact 117123058 115773693 1.01
tpch_q20/duckdb:vortex-compact 213302052 208677853 1.02
tpch_q21/duckdb:vortex-compact 629604559 636332808 0.99
tpch_q22/duckdb:vortex-compact 91140583 90214196 1.01
duckdb / parquet (1.012x ➖, 0↑ 1↓)
name PR 5881376 (ns) base 8efe1dc (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 268441540 258013092 1.04
tpch_q02/duckdb:parquet 106608169 103202903 1.03
tpch_q03/duckdb:parquet 208964269 209380266 1.00
tpch_q04/duckdb:parquet 136334864 135277250 1.01
tpch_q05/duckdb:parquet 224887189 217364613 1.03
tpch_q06/duckdb:parquet 69098363 69484022 0.99
tpch_q07/duckdb:parquet 180581878 180510606 1.00
tpch_q08/duckdb:parquet 254037098 255117463 1.00
tpch_q09/duckdb:parquet 457299848 465435666 0.98
tpch_q10/duckdb:parquet 611039712 606196294 1.01
tpch_q11/duckdb:parquet 🚨 43300752 39195832 1.10
tpch_q12/duckdb:parquet 123629889 127253260 0.97
tpch_q13/duckdb:parquet 425184684 398069268 1.07
tpch_q14/duckdb:parquet 170612562 171818534 0.99
tpch_q15/duckdb:parquet 100797362 97077157 1.04
tpch_q16/duckdb:parquet 153393332 163067867 0.94
tpch_q17/duckdb:parquet 177624882 176731998 1.01
tpch_q18/duckdb:parquet 354777245 347622141 1.02
tpch_q19/duckdb:parquet 283555706 277803323 1.02
tpch_q20/duckdb:parquet 236673688 230014242 1.03
tpch_q21/duckdb:parquet 567759474 569852327 1.00
tpch_q22/duckdb:parquet 289221202 290912870 0.99
duckdb / duckdb (0.999x ➖, 0↑ 0↓)
name PR 5881376 (ns) base 8efe1dc (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 116909449 116833331 1.00
tpch_q02/duckdb:duckdb 44808698 45847919 0.98
tpch_q03/duckdb:duckdb 97086234 96575711 1.01
tpch_q04/duckdb:duckdb 132558715 133192711 1.00
tpch_q05/duckdb:duckdb 109139448 108119082 1.01
tpch_q06/duckdb:duckdb 39082396 39172091 1.00
tpch_q07/duckdb:duckdb 86121796 86813180 0.99
tpch_q08/duckdb:duckdb 111952639 111347006 1.01
tpch_q09/duckdb:duckdb 277132836 278728671 0.99
tpch_q10/duckdb:duckdb 196839632 204914949 0.96
tpch_q11/duckdb:duckdb 15649780 14967880 1.05
tpch_q12/duckdb:duckdb 84220447 83615385 1.01
tpch_q13/duckdb:duckdb 252311413 252080774 1.00
tpch_q14/duckdb:duckdb 71495930 71128838 1.01
tpch_q15/duckdb:duckdb 78468185 78805868 1.00
tpch_q16/duckdb:duckdb 72920551 73799070 0.99
tpch_q17/duckdb:duckdb 84114536 85177261 0.99
tpch_q18/duckdb:duckdb 215258317 213020759 1.01
tpch_q19/duckdb:duckdb 116030946 115918913 1.00
tpch_q20/duckdb:duckdb 111706712 111855411 1.00
tpch_q21/duckdb:duckdb 304493123 308843267 0.99
tpch_q22/duckdb:duckdb 70015745 69466353 1.01
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow -0.3% +7.1% -6.9% +10.0% ➖ noise
1 datafusion:vortex-compact -2.3% +7.1% -8.8% +12.2% ➖ noise
1 datafusion:vortex-file-compressed -3.9% +7.1% -10.3% +11.7% ➖ noise
1 duckdb:duckdb +0.1% +7.1% -6.6% +10.0% ➖ noise
1 duckdb:vortex-compact +3.0% +7.1% -3.9% +10.0% ➖ noise
1 duckdb:vortex-file-compressed +1.9% +7.1% -4.9% +10.7% ➖ noise
2 datafusion:arrow +6.0% +2.3% +3.7% +10.0% ➖ noise
2 datafusion:vortex-compact -0.4% +2.3% -2.6% +10.0% ➖ noise
2 datafusion:vortex-file-compressed +3.9% +2.3% +1.6% +10.0% ➖ noise
2 duckdb:duckdb -2.3% +2.3% -4.4% +10.0% ➖ noise
2 duckdb:vortex-compact +1.0% +2.3% -1.2% +10.0% ➖ noise
2 duckdb:vortex-file-compressed -5.3% +2.3% -7.4% +10.0% ➖ noise
3 datafusion:arrow +1.7% -0.3% +2.0% +10.0% ➖ noise
3 datafusion:vortex-compact +0.1% -0.3% +0.5% +10.0% ➖ noise
3 datafusion:vortex-file-compressed +2.5% -0.3% +2.8% +10.0% ➖ noise
3 duckdb:duckdb +0.5% -0.3% +0.9% +10.0% ➖ noise
3 duckdb:vortex-compact -0.9% -0.3% -0.6% +10.0% ➖ noise
3 duckdb:vortex-file-compressed -0.5% -0.3% -0.1% +10.0% ➖ noise
4 datafusion:arrow +4.9% +0.1% +4.8% +10.0% ➖ noise
4 datafusion:vortex-compact +2.8% +0.1% +2.7% +10.0% ➖ noise
4 datafusion:vortex-file-compressed +2.0% +0.1% +1.9% +10.0% ➖ noise
4 duckdb:duckdb -0.5% +0.1% -0.6% +10.0% ➖ noise
4 duckdb:vortex-compact -2.0% +0.1% -2.1% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -0.9% +0.1% -1.0% +10.0% ➖ noise
5 datafusion:arrow +3.9% +1.9% +1.9% +10.0% ➖ noise
5 datafusion:vortex-compact +0.8% +1.9% -1.0% +10.0% ➖ noise
5 datafusion:vortex-file-compressed +2.1% +1.9% +0.2% +10.0% ➖ noise
5 duckdb:duckdb +0.9% +1.9% -0.9% +10.0% ➖ noise
5 duckdb:vortex-compact +0.4% +1.9% -1.5% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -0.3% +1.9% -2.2% +10.0% ➖ noise
6 datafusion:arrow +1.9% -0.4% +2.3% +10.0% ➖ noise
6 datafusion:vortex-compact +1.4% -0.4% +1.8% +10.0% ➖ noise
6 datafusion:vortex-file-compressed -0.6% -0.4% -0.2% +10.0% ➖ noise
6 duckdb:duckdb -0.2% -0.4% +0.1% +14.4% ➖ noise
6 duckdb:vortex-compact +2.0% -0.4% +2.3% +10.0% ➖ noise
6 duckdb:vortex-file-compressed +3.3% -0.4% +3.6% +10.0% ➖ noise
7 datafusion:arrow +2.1% +1.2% +0.9% +10.0% ➖ noise
7 datafusion:vortex-compact +1.8% +1.2% +0.6% +10.0% ➖ noise
7 datafusion:vortex-file-compressed +1.2% +1.2% +0.0% +10.0% ➖ noise
7 duckdb:duckdb -0.8% +1.2% -2.0% +10.1% ➖ noise
7 duckdb:vortex-compact +0.1% +1.2% -1.1% +10.0% ➖ noise
7 duckdb:vortex-file-compressed +1.1% +1.2% -0.1% +10.0% ➖ noise
8 datafusion:arrow +0.8% +0.1% +0.7% +10.0% ➖ noise
8 datafusion:vortex-compact +1.5% +0.1% +1.3% +10.0% ➖ noise
8 datafusion:vortex-file-compressed +0.8% +0.1% +0.7% +10.0% ➖ noise
8 duckdb:duckdb +0.5% +0.1% +0.4% +10.0% ➖ noise
8 duckdb:vortex-compact +0.2% +0.1% +0.1% +10.0% ➖ noise
8 duckdb:vortex-file-compressed +0.2% +0.1% +0.1% +10.0% ➖ noise
9 datafusion:arrow +2.6% -0.3% +2.9% +10.0% ➖ noise
9 datafusion:vortex-compact +0.2% -0.3% +0.5% +10.0% ➖ noise
9 datafusion:vortex-file-compressed -0.2% -0.3% +0.1% +10.0% ➖ noise
9 duckdb:duckdb -0.6% -0.3% -0.3% +10.0% ➖ noise
9 duckdb:vortex-compact +0.6% -0.3% +0.9% +10.0% ➖ noise
9 duckdb:vortex-file-compressed -0.2% -0.3% +0.1% +10.0% ➖ noise
10 datafusion:arrow +2.6% +1.1% +1.5% +10.0% ➖ noise
10 datafusion:vortex-compact +1.2% +1.1% +0.1% +10.0% ➖ noise
10 datafusion:vortex-file-compressed +1.6% +1.1% +0.5% +10.0% ➖ noise
10 duckdb:duckdb -3.9% +1.1% -5.0% +10.0% ➖ noise
10 duckdb:vortex-compact +1.1% +1.1% -0.0% +10.0% ➖ noise
10 duckdb:vortex-file-compressed +2.3% +1.1% +1.2% +10.0% ➖ noise
11 datafusion:arrow +3.8% +8.1% -4.0% +10.0% ➖ noise
11 datafusion:vortex-compact -1.4% +8.1% -8.8% +10.0% ➖ noise
11 datafusion:vortex-file-compressed -1.7% +8.1% -9.1% +10.5% ➖ noise
11 duckdb:duckdb +4.6% +8.1% -3.3% +22.7% ➖ noise
11 duckdb:vortex-compact +0.9% +8.1% -6.7% +13.2% ➖ noise
11 duckdb:vortex-file-compressed -3.3% +8.1% -10.6% +15.0% ➖ noise
12 datafusion:arrow -2.9% -1.4% -1.5% +44.4% ➖ noise
12 datafusion:vortex-compact -1.0% -1.4% +0.4% +10.0% ➖ noise
12 datafusion:vortex-file-compressed +1.4% -1.4% +2.9% +10.0% ➖ noise
12 duckdb:duckdb +0.7% -1.4% +2.2% +10.0% ➖ noise
12 duckdb:vortex-compact +2.0% -1.4% +3.5% +10.0% ➖ noise
12 duckdb:vortex-file-compressed +1.6% -1.4% +3.1% +10.0% ➖ noise
13 datafusion:arrow +2.7% +4.0% -1.3% +10.7% ➖ noise
13 datafusion:vortex-compact +1.6% +4.0% -2.3% +10.0% ➖ noise
13 datafusion:vortex-file-compressed +2.3% +4.0% -1.6% +10.0% ➖ noise
13 duckdb:duckdb +0.1% +4.0% -3.8% +10.0% ➖ noise
13 duckdb:vortex-compact +2.0% +4.0% -1.9% +10.0% ➖ noise
13 duckdb:vortex-file-compressed +2.1% +4.0% -1.8% +10.0% ➖ noise
14 datafusion:arrow +2.7% -0.2% +2.9% +10.0% ➖ noise
14 datafusion:vortex-compact +0.8% -0.2% +1.0% +10.0% ➖ noise
14 datafusion:vortex-file-compressed +2.3% -0.2% +2.5% +10.0% ➖ noise
14 duckdb:duckdb +0.5% -0.2% +0.7% +10.0% ➖ noise
14 duckdb:vortex-compact -1.3% -0.2% -1.1% +10.0% ➖ noise
14 duckdb:vortex-file-compressed +1.6% -0.2% +1.7% +10.0% ➖ noise
15 datafusion:arrow -0.3% +3.8% -4.0% +10.0% ➖ noise
15 datafusion:vortex-compact +3.0% +3.8% -0.8% +10.0% ➖ noise
15 datafusion:vortex-file-compressed +1.5% +3.8% -2.3% +10.0% ➖ noise
15 duckdb:duckdb -0.4% +3.8% -4.1% +10.0% ➖ noise
15 duckdb:vortex-compact +1.2% +3.8% -2.5% +10.0% ➖ noise
15 duckdb:vortex-file-compressed +3.6% +3.8% -0.3% +10.0% ➖ noise
16 datafusion:arrow -4.7% -2.0% -2.8% +10.6% ➖ noise
16 datafusion:vortex-compact +0.8% -2.0% +2.9% +10.9% ➖ noise
16 datafusion:vortex-file-compressed +0.8% -2.0% +2.8% +11.0% ➖ noise
16 duckdb:duckdb -1.2% -2.0% +0.8% +10.0% ➖ noise
16 duckdb:vortex-compact +1.4% -2.0% +3.4% +10.8% ➖ noise
16 duckdb:vortex-file-compressed +3.2% -2.0% +5.2% +10.1% ➖ noise
17 datafusion:arrow +1.9% +1.9% -0.0% +10.0% ➖ noise
17 datafusion:vortex-compact +1.9% +1.9% +0.0% +10.0% ➖ noise
17 datafusion:vortex-file-compressed +2.5% +1.9% +0.6% +10.0% ➖ noise
17 duckdb:duckdb -1.2% +1.9% -3.1% +10.0% ➖ noise
17 duckdb:vortex-compact +1.8% +1.9% -0.1% +10.0% ➖ noise
17 duckdb:vortex-file-compressed +1.0% +1.9% -0.9% +10.0% ➖ noise
18 datafusion:arrow +3.4% +2.3% +1.1% +10.0% ➖ noise
18 datafusion:vortex-compact +1.1% +2.3% -1.1% +10.0% ➖ noise
18 datafusion:vortex-file-compressed +1.7% +2.3% -0.6% +10.0% ➖ noise
18 duckdb:duckdb +1.1% +2.3% -1.2% +10.0% ➖ noise
18 duckdb:vortex-compact -0.4% +2.3% -2.6% +10.0% ➖ noise
18 duckdb:vortex-file-compressed -1.9% +2.3% -4.1% +10.0% ➖ noise
19 datafusion:arrow +1.9% +3.0% -1.1% +10.0% ➖ noise
19 datafusion:vortex-compact -0.5% +3.0% -3.4% +10.0% ➖ noise
19 datafusion:vortex-file-compressed -0.9% +3.0% -3.8% +10.0% ➖ noise
19 duckdb:duckdb +0.1% +3.0% -2.8% +10.0% ➖ noise
19 duckdb:vortex-compact +1.2% +3.0% -1.8% +10.0% ➖ noise
19 duckdb:vortex-file-compressed -1.3% +3.0% -4.2% +10.0% ➖ noise
20 datafusion:arrow +2.4% +1.6% +0.8% +10.0% ➖ noise
20 datafusion:vortex-compact +0.2% +1.6% -1.4% +10.0% ➖ noise
20 datafusion:vortex-file-compressed +1.5% +1.6% -0.1% +10.0% ➖ noise
20 duckdb:duckdb -0.1% +1.6% -1.7% +10.0% ➖ noise
20 duckdb:vortex-compact +2.2% +1.6% +0.6% +10.0% ➖ noise
20 duckdb:vortex-file-compressed +1.5% +1.6% -0.1% +10.0% ➖ noise
21 datafusion:arrow +1.4% +0.5% +0.9% +10.0% ➖ noise
21 datafusion:vortex-compact +0.8% +0.5% +0.3% +10.0% ➖ noise
21 datafusion:vortex-file-compressed +1.2% +0.5% +0.8% +10.0% ➖ noise
21 duckdb:duckdb -1.4% +0.5% -1.9% +10.0% ➖ noise
21 duckdb:vortex-compact -1.1% +0.5% -1.5% +10.0% ➖ noise
21 duckdb:vortex-file-compressed +0.3% +0.5% -0.1% +10.0% ➖ noise
22 datafusion:arrow +0.7% -0.4% +1.1% +10.0% ➖ noise
22 datafusion:vortex-compact +1.7% -0.4% +2.1% +10.0% ➖ noise
22 datafusion:vortex-file-compressed -3.0% -0.4% -2.6% +10.0% ➖ noise
22 duckdb:duckdb +0.8% -0.4% +1.2% +11.3% ➖ noise
22 duckdb:vortex-compact +1.0% -0.4% +1.4% +10.0% ➖ noise
22 duckdb:vortex-file-compressed +2.9% -0.4% +3.4% +10.0% ➖ noise

@github-actions
Copy link
Contributor

github-actions bot commented Mar 18, 2026 •
edited
Loading

Benchmarks: TPC-H SF=1 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +4.4%
Vortex (geomean): 0.960x ➖
Parquet (geomean): 0.919x ➖
Shifts: Parquet (control) -8.1% · Median polish -4.0%

datafusion / vortex-file-compressed (0.840x ➖, 2↑ 0↓)
name PR 5881376 (ns) base 8efe1dc (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 183971481 183699536 1.00
tpch_q02/datafusion:vortex-file-compressed 423283610 555080062 0.76
tpch_q03/datafusion:vortex-file-compressed 330955440 420821914 0.79
tpch_q04/datafusion:vortex-file-compressed 209956766 289424987 0.73
tpch_q05/datafusion:vortex-file-compressed 437763033 468365859 0.93
tpch_q06/datafusion:vortex-file-compressed 261328958 290199045 0.90
tpch_q07/datafusion:vortex-file-compressed 406403183 473326111 0.86
tpch_q08/datafusion:vortex-file-compressed 651421466 661434298 0.98
tpch_q09/datafusion:vortex-file-compressed 420527162 563150724 0.75
tpch_q10/datafusion:vortex-file-compressed 474309834 555787729 0.85
tpch_q11/datafusion:vortex-file-compressed 279164734 276013121 1.01
tpch_q12/datafusion:vortex-file-compressed 369272969 523419495 0.71
tpch_q13/datafusion:vortex-file-compressed 205599723 268737657 0.77
tpch_q14/datafusion:vortex-file-compressed 175116542 183327996 0.96
tpch_q15/datafusion:vortex-file-compressed 301939208 362607049 0.83
tpch_q16/datafusion:vortex-file-compressed 171252108 216294521 0.79
tpch_q17/datafusion:vortex-file-compressed 327128009 346407821 0.94
tpch_q18/datafusion:vortex-file-compressed 338360607 367807919 0.92
tpch_q19/datafusion:vortex-file-compressed 🚀 330088350 486066321 0.68
tpch_q20/datafusion:vortex-file-compressed 544635935 540312352 1.01
tpch_q21/datafusion:vortex-file-compressed 481405758 602936449 0.80
tpch_q22/datafusion:vortex-file-compressed 🚀 146438196 220547679 0.66
datafusion / vortex-compact (0.956x ➖, 1↑ 1↓)
name PR 5881376 (ns) base 8efe1dc (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 268544648 273354219 0.98
tpch_q02/datafusion:vortex-compact 428527396 548315374 0.78
tpch_q03/datafusion:vortex-compact 368335426 306611572 1.20
tpch_q04/datafusion:vortex-compact 263392885 266357748 0.99
tpch_q05/datafusion:vortex-compact 408824088 504006885 0.81
tpch_q06/datafusion:vortex-compact 🚀 314009230 452975187 0.69
tpch_q07/datafusion:vortex-compact 433426438 485361906 0.89
tpch_q08/datafusion:vortex-compact 586476659 742595601 0.79
tpch_q09/datafusion:vortex-compact 503121369 553702946 0.91
tpch_q10/datafusion:vortex-compact 496805586 465169118 1.07
tpch_q11/datafusion:vortex-compact 294060927 333380292 0.88
tpch_q12/datafusion:vortex-compact 484075725 643052590 0.75
tpch_q13/datafusion:vortex-compact 217020017 231458505 0.94
tpch_q14/datafusion:vortex-compact 323055168 421398085 0.77
tpch_q15/datafusion:vortex-compact 496114496 525694624 0.94
tpch_q16/datafusion:vortex-compact 190925279 182944766 1.04
tpch_q17/datafusion:vortex-compact 353816798 330437673 1.07
tpch_q18/datafusion:vortex-compact 318156049 278965983 1.14
tpch_q19/datafusion:vortex-compact 🚨 493235496 361961173 1.36
tpch_q20/datafusion:vortex-compact 499807904 446403786 1.12
tpch_q21/datafusion:vortex-compact 541662742 576384740 0.94
tpch_q22/datafusion:vortex-compact 156775454 121535380 1.29
datafusion / parquet (0.882x ➖, 4↑ 0↓)
name PR 5881376 (ns) base 8efe1dc (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 230857314 271846228 0.85
tpch_q02/datafusion:parquet 🚀 429913340 694977979 0.62
tpch_q03/datafusion:parquet 290813719 341851826 0.85
tpch_q04/datafusion:parquet 147105242 152883535 0.96
tpch_q05/datafusion:parquet 556673189 534326488 1.04
tpch_q06/datafusion:parquet 137351138 163536448 0.84
tpch_q07/datafusion:parquet 540225613 539771453 1.00
tpch_q08/datafusion:parquet 🚀 613557120 1024645372 0.60
tpch_q09/datafusion:parquet 🚀 548233023 910594082 0.60
tpch_q10/datafusion:parquet 570952172 624043562 0.91
tpch_q11/datafusion:parquet 🚀 353617986 530776651 0.67
tpch_q12/datafusion:parquet 291703460 271064962 1.08
tpch_q13/datafusion:parquet 430557070 428237712 1.01
tpch_q14/datafusion:parquet 202471157 226460813 0.89
tpch_q15/datafusion:parquet 290401960 289630743 1.00
tpch_q16/datafusion:parquet 195713086 199008855 0.98
tpch_q17/datafusion:parquet 401253909 401773539 1.00
tpch_q18/datafusion:parquet 490648388 509071266 0.96
tpch_q19/datafusion:parquet 358601171 379309134 0.95
tpch_q20/datafusion:parquet 555928808 475191905 1.17
tpch_q21/datafusion:parquet 565281062 756640362 0.75
tpch_q22/datafusion:parquet 225894451 224294694 1.01
duckdb / vortex-file-compressed (1.007x ➖, 0↑ 1↓)
name PR 5881376 (ns) base 8efe1dc (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 275679417 270315316 1.02
tpch_q02/duckdb:vortex-file-compressed 960407098 893408729 1.07
tpch_q03/duckdb:vortex-file-compressed 516534399 637019612 0.81
tpch_q04/duckdb:vortex-file-compressed 431595154 523806016 0.82
tpch_q05/duckdb:vortex-file-compressed 908041060 943655380 0.96
tpch_q06/duckdb:vortex-file-compressed 434850777 442657198 0.98
tpch_q07/duckdb:vortex-file-compressed 830396249 711661667 1.17
tpch_q08/duckdb:vortex-file-compressed 955453896 828751615 1.15
tpch_q09/duckdb:vortex-file-compressed 🚨 1201583830 870106634 1.38
tpch_q10/duckdb:vortex-file-compressed 703621745 751706910 0.94
tpch_q11/duckdb:vortex-file-compressed 503426426 524153949 0.96
tpch_q12/duckdb:vortex-file-compressed 512939151 561072364 0.91
tpch_q13/duckdb:vortex-file-compressed 469483118 442017862 1.06
tpch_q14/duckdb:vortex-file-compressed 478584311 429781400 1.11
tpch_q15/duckdb:vortex-file-compressed 286341520 306156819 0.94
tpch_q16/duckdb:vortex-file-compressed 327125966 318961531 1.03
tpch_q17/duckdb:vortex-file-compressed 661950884 551294161 1.20
tpch_q18/duckdb:vortex-file-compressed 553416220 703067700 0.79
tpch_q19/duckdb:vortex-file-compressed 473068197 485618783 0.97
tpch_q20/duckdb:vortex-file-compressed 845535227 739467431 1.14
tpch_q21/duckdb:vortex-file-compressed 1027253115 1049119450 0.98
tpch_q22/duckdb:vortex-file-compressed 322887140 341453341 0.95
duckdb / vortex-compact (1.050x ➖, 0↑ 0↓)
name PR 5881376 (ns) base 8efe1dc (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 274834452 282009861 0.97
tpch_q02/duckdb:vortex-compact 960524013 888139199 1.08
tpch_q03/duckdb:vortex-compact 562996129 482730636 1.17
tpch_q04/duckdb:vortex-compact 312275744 374319007 0.83
tpch_q05/duckdb:vortex-compact 844947861 853810542 0.99
tpch_q06/duckdb:vortex-compact 372938315 350934462 1.06
tpch_q07/duckdb:vortex-compact 663088204 587693621 1.13
tpch_q08/duckdb:vortex-compact 884139068 722268698 1.22
tpch_q09/duckdb:vortex-compact 827257247 787620244 1.05
tpch_q10/duckdb:vortex-compact 649775684 590380813 1.10
tpch_q11/duckdb:vortex-compact 505804372 434225730 1.16
tpch_q12/duckdb:vortex-compact 436162626 383637313 1.14
tpch_q13/duckdb:vortex-compact 452498284 419125679 1.08
tpch_q14/duckdb:vortex-compact 466936179 531206634 0.88
tpch_q15/duckdb:vortex-compact 343578451 278743219 1.23
tpch_q16/duckdb:vortex-compact 346331485 333889974 1.04
tpch_q17/duckdb:vortex-compact 572445836 646456480 0.89
tpch_q18/duckdb:vortex-compact 483950244 515405559 0.94
tpch_q19/duckdb:vortex-compact 493975476 415609413 1.19
tpch_q20/duckdb:vortex-compact 778305267 776206262 1.00
tpch_q21/duckdb:vortex-compact 1006105777 989271318 1.02
tpch_q22/duckdb:vortex-compact 334967820 317493662 1.06
duckdb / parquet (0.959x ➖, 0↑ 0↓)
name PR 5881376 (ns) base 8efe1dc (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 453477589 473826216 0.96
tpch_q02/duckdb:parquet 1218046040 1238835087 0.98
tpch_q03/duckdb:parquet 954891350 933119689 1.02
tpch_q04/duckdb:parquet 557208953 628243959 0.89
tpch_q05/duckdb:parquet 1461431704 1495271330 0.98
tpch_q06/duckdb:parquet 396353853 362547409 1.09
tpch_q07/duckdb:parquet 1033746961 1275414509 0.81
tpch_q08/duckdb:parquet 1569446417 1652759710 0.95
tpch_q09/duckdb:parquet 1394787729 1333384276 1.05
tpch_q10/duckdb:parquet 1421211904 1409107316 1.01
tpch_q11/duckdb:parquet 843785941 792585606 1.06
tpch_q12/duckdb:parquet 625325181 584961001 1.07
tpch_q13/duckdb:parquet 829851409 893094969 0.93
tpch_q14/duckdb:parquet 689413731 738272841 0.93
tpch_q15/duckdb:parquet 453795682 602216628 0.75
tpch_q16/duckdb:parquet 516727154 594681856 0.87
tpch_q17/duckdb:parquet 664890768 779897223 0.85
tpch_q18/duckdb:parquet 846807120 938851313 0.90
tpch_q19/duckdb:parquet 761344403 750976566 1.01
tpch_q20/duckdb:parquet 1065084025 1068057140 1.00
tpch_q21/duckdb:parquet 1355535984 1150786492 1.18
tpch_q22/duckdb:parquet 481269694 536357204 0.90
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact -1.8% -9.8% +9.0% +157.1% ➖ noise
1 datafusion:vortex-file-compressed +0.1% -9.8% +11.1% +160.2% ➖ noise
1 duckdb:vortex-compact -2.5% -9.8% +8.1% +37.7% ➖ noise
1 duckdb:vortex-file-compressed +2.0% -9.8% +13.1% +49.3% ➖ noise
2 datafusion:vortex-compact -21.8% -22.0% +0.2% +80.3% ➖ noise
2 datafusion:vortex-file-compressed -23.7% -22.0% -2.2% +34.0% ➖ noise
2 duckdb:vortex-compact +8.2% -22.0% +38.7% +37.4% 🚨 regression
2 duckdb:vortex-file-compressed +7.5% -22.0% +37.8% +30.0% 🚨 regression
3 datafusion:vortex-compact +20.1% -6.7% +28.8% +81.7% ➖ noise
3 datafusion:vortex-file-compressed -21.4% -6.7% -15.7% +76.7% ➖ noise
3 duckdb:vortex-compact +16.6% -6.7% +25.0% +32.5% ➖ noise
3 duckdb:vortex-file-compressed -18.9% -6.7% -13.1% +48.6% ➖ noise
4 datafusion:vortex-compact -1.1% -7.6% +7.0% +61.1% ➖ noise
4 datafusion:vortex-file-compressed -27.5% -7.6% -21.5% +57.6% ➖ noise
4 duckdb:vortex-compact -16.6% -7.6% -9.7% +35.4% ➖ noise
4 duckdb:vortex-file-compressed -17.6% -7.6% -10.8% +30.0% ➖ noise
5 datafusion:vortex-compact -18.9% +0.9% -19.6% +30.0% ➖ noise
5 datafusion:vortex-file-compressed -6.5% +0.9% -7.4% +30.0% ➖ noise
5 duckdb:vortex-compact -1.0% +0.9% -1.9% +30.0% ➖ noise
5 duckdb:vortex-file-compressed -3.8% +0.9% -4.6% +30.0% ➖ noise
6 datafusion:vortex-compact -30.7% -4.2% -27.7% +65.8% ➖ noise
6 datafusion:vortex-file-compressed -9.9% -4.2% -6.0% +39.3% ➖ noise
6 duckdb:vortex-compact +6.3% -4.2% +10.9% +35.8% ➖ noise
6 duckdb:vortex-file-compressed -1.8% -4.2% +2.5% +42.6% ➖ noise
7 datafusion:vortex-compact -10.7% -9.9% -0.9% +46.5% ➖ noise
7 datafusion:vortex-file-compressed -14.1% -9.9% -4.7% +30.0% ➖ noise
7 duckdb:vortex-compact +12.8% -9.9% +25.3% +30.0% ➖ noise
7 duckdb:vortex-file-compressed +16.7% -9.9% +29.6% +30.0% ➖ noise
8 datafusion:vortex-compact -21.0% -24.6% +4.7% +33.8% ➖ noise
8 datafusion:vortex-file-compressed -1.5% -24.6% +30.6% +30.2% 🚨 regression
8 duckdb:vortex-compact +22.4% -24.6% +62.3% +30.0% 🚨 regression
8 duckdb:vortex-file-compressed +15.3% -24.6% +52.9% +30.0% 🚨 regression
9 datafusion:vortex-compact -9.1% -20.6% +14.5% +39.9% ➖ noise
9 datafusion:vortex-file-compressed -25.3% -20.6% -5.9% +30.0% ➖ noise
9 duckdb:vortex-compact +5.0% -20.6% +32.4% +30.0% 🚨 regression
9 duckdb:vortex-file-compressed +38.1% -20.6% +74.0% +30.9% 🚨 regression
10 datafusion:vortex-compact +6.8% -3.9% +11.2% +44.4% ➖ noise
10 datafusion:vortex-file-compressed -14.7% -3.9% -11.2% +40.2% ➖ noise
10 duckdb:vortex-compact +10.1% -3.9% +14.6% +30.0% ➖ noise
10 duckdb:vortex-file-compressed -6.4% -3.9% -2.6% +30.0% ➖ noise
11 datafusion:vortex-compact -11.8% -15.8% +4.7% +51.3% ➖ noise
11 datafusion:vortex-file-compressed +1.1% -15.8% +20.1% +30.0% ➖ noise
11 duckdb:vortex-compact +16.5% -15.8% +38.3% +30.0% 🚨 regression
11 duckdb:vortex-file-compressed -4.0% -15.8% +14.0% +30.0% ➖ noise
12 datafusion:vortex-compact -24.7% +7.3% -29.8% +60.9% ➖ noise
12 datafusion:vortex-file-compressed -29.4% +7.3% -34.2% +38.5% ✅ faster
12 duckdb:vortex-compact +13.7% +7.3% +6.0% +37.9% ➖ noise
12 duckdb:vortex-file-compressed -8.6% +7.3% -14.8% +66.3% ➖ noise
13 datafusion:vortex-compact -6.2% -3.3% -3.0% +114.3% ➖ noise
13 datafusion:vortex-file-compressed -23.5% -3.3% -20.8% +40.6% ➖ noise
13 duckdb:vortex-compact +8.0% -3.3% +11.7% +33.2% ➖ noise
13 duckdb:vortex-file-compressed +6.2% -3.3% +9.9% +30.0% ➖ noise
14 datafusion:vortex-compact -23.3% -8.6% -16.1% +66.1% ➖ noise
14 datafusion:vortex-file-compressed -4.5% -8.6% +4.5% +30.0% ➖ noise
14 duckdb:vortex-compact -12.1% -8.6% -3.8% +38.3% ➖ noise
14 duckdb:vortex-file-compressed +11.4% -8.6% +21.9% +30.0% ➖ noise
15 datafusion:vortex-compact -5.6% -13.1% +8.6% +41.8% ➖ noise
15 datafusion:vortex-file-compressed -16.7% -13.1% -4.2% +32.9% ➖ noise
15 duckdb:vortex-compact +23.3% -13.1% +41.8% +55.8% ➖ noise
15 duckdb:vortex-file-compressed -6.5% -13.1% +7.6% +32.6% ➖ noise
16 datafusion:vortex-compact +4.4% -7.6% +12.9% +30.0% ➖ noise
16 datafusion:vortex-file-compressed -20.8% -7.6% -14.3% +57.3% ➖ noise
16 duckdb:vortex-compact +3.7% -7.6% +12.2% +30.0% ➖ noise
16 duckdb:vortex-file-compressed +2.6% -7.6% +10.9% +30.0% ➖ noise
17 datafusion:vortex-compact +7.1% -7.7% +16.0% +67.4% ➖ noise
17 datafusion:vortex-file-compressed -5.6% -7.7% +2.3% +73.2% ➖ noise
17 duckdb:vortex-compact -11.4% -7.7% -4.0% +30.0% ➖ noise
17 duckdb:vortex-file-compressed +20.1% -7.7% +30.1% +30.0% 🚨 regression
18 datafusion:vortex-compact +14.0% -6.8% +22.3% +46.7% ➖ noise
18 datafusion:vortex-file-compressed -8.0% -6.8% -1.3% +45.0% ➖ noise
18 duckdb:vortex-compact -6.1% -6.8% +0.7% +30.0% ➖ noise
18 duckdb:vortex-file-compressed -21.3% -6.8% -15.6% +30.0% ➖ noise
19 datafusion:vortex-compact +36.3% -2.1% +39.2% +35.7% 🚨 regression
19 datafusion:vortex-file-compressed -32.1% -2.1% -30.6% +36.8% ✅ faster
19 duckdb:vortex-compact +18.9% -2.1% +21.4% +37.8% ➖ noise
19 duckdb:vortex-file-compressed -2.6% -2.1% -0.5% +33.5% ➖ noise
20 datafusion:vortex-compact +12.0% +8.0% +3.7% +48.1% ➖ noise
20 datafusion:vortex-file-compressed +0.8% +8.0% -6.7% +31.4% ➖ noise
20 duckdb:vortex-compact +0.3% +8.0% -7.2% +33.1% ➖ noise
20 duckdb:vortex-file-compressed +14.3% +8.0% +5.9% +44.5% ➖ noise
21 datafusion:vortex-compact -6.0% -6.2% +0.2% +30.0% ➖ noise
21 datafusion:vortex-file-compressed -20.2% -6.2% -14.9% +31.1% ➖ noise
21 duckdb:vortex-compact +1.7% -6.2% +8.4% +30.0% ➖ noise
21 duckdb:vortex-file-compressed -2.1% -6.2% +4.4% +30.0% ➖ noise
22 datafusion:vortex-compact +29.0% -4.9% +35.7% +34.7% 🚨 regression
22 datafusion:vortex-file-compressed -33.6% -4.9% -30.2% +42.0% ✅ faster
22 duckdb:vortex-compact +5.5% -4.9% +11.0% +31.4% ➖ noise
22 duckdb:vortex-file-compressed -5.4% -4.9% -0.5% +30.0% ➖ noise

@github-actions
Copy link
Contributor

github-actions bot commented Mar 18, 2026 •
edited
Loading

Benchmarks: FineWeb S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +0.8%
Vortex (geomean): 0.965x ➖
Parquet (geomean): 0.957x ➖
Shifts: Parquet (control) -4.3% · Median polish +2.8%

datafusion / vortex-file-compressed (1.035x ➖, 0↑ 0↓)
name PR 5881376 (ns) base 8efe1dc (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 39905950 31029504 1.29
fineweb_q01/datafusion:vortex-file-compressed 533630722 589120404 0.91
fineweb_q02/datafusion:vortex-file-compressed 511508651 543957012 0.94
fineweb_q03/datafusion:vortex-file-compressed 1499108654 1370400520 1.09
fineweb_q04/datafusion:vortex-file-compressed 1442390987 1360977531 1.06
fineweb_q05/datafusion:vortex-file-compressed 1402622588 1415047602 0.99
fineweb_q06/datafusion:vortex-file-compressed 1528056977 1627916874 0.94
fineweb_q07/datafusion:vortex-file-compressed 1432137981 1346814519 1.06
fineweb_q08/datafusion:vortex-file-compressed 596408711 549210657 1.09
datafusion / vortex-compact (0.880x ➖, 2↑ 0↓)
name PR 5881376 (ns) base 8efe1dc (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 37637296 31146983 1.21
fineweb_q01/datafusion:vortex-compact 🚀 539911271 893540344 0.60
fineweb_q02/datafusion:vortex-compact 🚀 660118924 1011330245 0.65
fineweb_q03/datafusion:vortex-compact 1833544236 1842606507 1.00
fineweb_q04/datafusion:vortex-compact 2186722384 2200587319 0.99
fineweb_q05/datafusion:vortex-compact 1686704236 1704393846 0.99
fineweb_q06/datafusion:vortex-compact 1450190324 2000023916 0.73
fineweb_q07/datafusion:vortex-compact 1353096957 1431597510 0.95
fineweb_q08/datafusion:vortex-compact 411681028 414441224 0.99
datafusion / parquet (0.915x ➖, 0↑ 0↓)
name PR 5881376 (ns) base 8efe1dc (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 1212706012 1078955506 1.12
fineweb_q01/datafusion:parquet 1857705032 1959978760 0.95
fineweb_q02/datafusion:parquet 1824912713 1798185346 1.01
fineweb_q03/datafusion:parquet 1766357636 2019717468 0.87
fineweb_q04/datafusion:parquet 1902385990 2201400420 0.86
fineweb_q05/datafusion:parquet 1945035773 2211123867 0.88
fineweb_q06/datafusion:parquet 1770542851 2262045954 0.78
fineweb_q07/datafusion:parquet 1974169820 1912882016 1.03
fineweb_q08/datafusion:parquet 1837020159 2372380969 0.77
duckdb / vortex-file-compressed (0.989x ➖, 0↑ 0↓)
name PR 5881376 (ns) base 8efe1dc (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 91742091 106081581 0.86
fineweb_q01/duckdb:vortex-file-compressed 602228993 683594547 0.88
fineweb_q02/duckdb:vortex-file-compressed 456307692 513628391 0.89
fineweb_q03/duckdb:vortex-file-compressed 1609291098 1451268285 1.11
fineweb_q04/duckdb:vortex-file-compressed 1533434210 1495106542 1.03
fineweb_q05/duckdb:vortex-file-compressed 1542385878 1487403818 1.04
fineweb_q06/duckdb:vortex-file-compressed 1744788882 1626348612 1.07
fineweb_q07/duckdb:vortex-file-compressed 1497853340 1416946913 1.06
fineweb_q08/duckdb:vortex-file-compressed 618858275 616646417 1.00
duckdb / vortex-compact (0.963x ➖, 0↑ 0↓)
name PR 5881376 (ns) base 8efe1dc (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 85126969 109966437 0.77
fineweb_q01/duckdb:vortex-compact 613417556 679200696 0.90
fineweb_q02/duckdb:vortex-compact 534344089 578648597 0.92
fineweb_q03/duckdb:vortex-compact 1637802470 1617446935 1.01
fineweb_q04/duckdb:vortex-compact 1669015940 1578858991 1.06
fineweb_q05/duckdb:vortex-compact 1479012332 1466023568 1.01
fineweb_q06/duckdb:vortex-compact 1551342147 1609114432 0.96
fineweb_q07/duckdb:vortex-compact 1359520396 1296127383 1.05
fineweb_q08/duckdb:vortex-compact 475048718 469889352 1.01
duckdb / parquet (1.002x ➖, 0↑ 0↓)
name PR 5881376 (ns) base 8efe1dc (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 1104528068 1175413122 0.94
fineweb_q01/duckdb:parquet 1609805156 1661297264 0.97
fineweb_q02/duckdb:parquet 1647240668 1706418599 0.97
fineweb_q03/duckdb:parquet 4349021477 4073424982 1.07
fineweb_q04/duckdb:parquet 1936921736 1961275918 0.99
fineweb_q05/duckdb:parquet 3000973113 2604993516 1.15
fineweb_q06/duckdb:parquet 3352651370 3732604951 0.90
fineweb_q07/duckdb:parquet 4352603627 4155317970 1.05
fineweb_q08/duckdb:parquet 1053954879 1042973835 1.01
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact +20.8% +2.8% +17.6% +205.6% ➖ noise
0 datafusion:vortex-file-compressed +28.6% +2.8% +25.1% +216.9% ➖ noise
0 duckdb:vortex-compact -22.6% +2.8% -24.7% +58.0% ➖ noise
0 duckdb:vortex-file-compressed -13.5% +2.8% -15.8% +49.4% ➖ noise
1 datafusion:vortex-compact -39.6% -4.2% -37.0% +49.1% ✅ faster
1 datafusion:vortex-file-compressed -9.4% -4.2% -5.5% +97.1% ➖ noise
1 duckdb:vortex-compact -9.7% -4.2% -5.8% +40.8% ➖ noise
1 duckdb:vortex-file-compressed -11.9% -4.2% -8.1% +30.0% ➖ noise
2 datafusion:vortex-compact -34.7% -1.0% -34.1% +37.8% ✅ faster
2 datafusion:vortex-file-compressed -6.0% -1.0% -5.0% +30.0% ➖ noise
2 duckdb:vortex-compact -7.7% -1.0% -6.7% +30.0% ➖ noise
2 duckdb:vortex-file-compressed -11.2% -1.0% -10.2% +30.0% ➖ noise
3 datafusion:vortex-compact -0.5% -3.4% +3.0% +30.0% ➖ noise
3 datafusion:vortex-file-compressed +9.4% -3.4% +13.2% +30.0% ➖ noise
3 duckdb:vortex-compact +1.3% -3.4% +4.8% +30.0% ➖ noise
3 duckdb:vortex-file-compressed +10.9% -3.4% +14.8% +30.0% ➖ noise
4 datafusion:vortex-compact -0.6% -7.6% +7.6% +30.0% ➖ noise
4 datafusion:vortex-file-compressed +6.0% -7.6% +14.7% +30.0% ➖ noise
4 duckdb:vortex-compact +5.7% -7.6% +14.4% +30.0% ➖ noise
4 duckdb:vortex-file-compressed +2.6% -7.6% +11.0% +30.0% ➖ noise
5 datafusion:vortex-compact -1.0% +0.7% -1.7% +30.0% ➖ noise
5 datafusion:vortex-file-compressed -0.9% +0.7% -1.5% +30.0% ➖ noise
5 duckdb:vortex-compact +0.9% +0.7% +0.2% +30.0% ➖ noise
5 duckdb:vortex-file-compressed +3.7% +0.7% +3.0% +30.0% ➖ noise
6 datafusion:vortex-compact -27.5% -16.2% -13.5% +30.0% ➖ noise
6 datafusion:vortex-file-compressed -6.1% -16.2% +11.9% +30.0% ➖ noise
6 duckdb:vortex-compact -3.6% -16.2% +15.0% +30.0% ➖ noise
6 duckdb:vortex-file-compressed +7.3% -16.2% +27.9% +30.0% ➖ noise
7 datafusion:vortex-compact -5.5% +4.0% -9.1% +33.4% ➖ noise
7 datafusion:vortex-file-compressed +6.3% +4.0% +2.3% +30.0% ➖ noise
7 duckdb:vortex-compact +4.9% +4.0% +0.9% +30.0% ➖ noise
7 duckdb:vortex-file-compressed +5.7% +4.0% +1.7% +30.0% ➖ noise
8 datafusion:vortex-compact -0.7% -11.5% +12.3% +30.0% ➖ noise
8 datafusion:vortex-file-compressed +8.6% -11.5% +22.8% +30.0% ➖ noise
8 duckdb:vortex-compact +1.1% -11.5% +14.3% +30.0% ➖ noise
8 duckdb:vortex-file-compressed +0.4% -11.5% +13.5% +30.0% ➖ noise

@github-actions
Copy link
Contributor

github-actions bot commented Mar 18, 2026 •
edited
Loading

Benchmarks: Statistical and Population Genetics

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +1.9%
Vortex (geomean): 1.011x ➖
Parquet (geomean): 0.992x ➖
Shifts: Parquet (control) -0.8% · Median polish +0.1%

duckdb / vortex-file-compressed (1.001x ➖, 0↑ 0↓)
name PR 5881376 (ns) base 8efe1dc (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-file-compressed 10718127 10832844 0.99
statpopgen_q01/duckdb:vortex-file-compressed 25471246 27486951 0.93
statpopgen_q02/duckdb:vortex-file-compressed 1313669508 1301565991 1.01
statpopgen_q03/duckdb:vortex-file-compressed 3010901155 3040691752 0.99
statpopgen_q04/duckdb:vortex-file-compressed 2950028118 3021023961 0.98
statpopgen_q05/duckdb:vortex-file-compressed 1379285457 1378523856 1.00
statpopgen_q06/duckdb:vortex-file-compressed 2036279619 2036853858 1.00
statpopgen_q07/duckdb:vortex-file-compressed 197029319 191043904 1.03
statpopgen_q08/duckdb:vortex-file-compressed 211910173 200618752 1.06
statpopgen_q09/duckdb:vortex-file-compressed 2843831118 2808453041 1.01
statpopgen_q10/duckdb:vortex-file-compressed 4594372487 4504921691 1.02
duckdb / vortex-compact (1.021x ➖, 0↑ 0↓)
name PR 5881376 (ns) base 8efe1dc (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-compact 10613086 10618639 1.00
statpopgen_q01/duckdb:vortex-compact 169153395 164339448 1.03
statpopgen_q02/duckdb:vortex-compact 1890595824 1805533811 1.05
statpopgen_q03/duckdb:vortex-compact 3661599986 3428706239 1.07
statpopgen_q04/duckdb:vortex-compact 3562837690 3493524145 1.02
statpopgen_q05/duckdb:vortex-compact 1830392272 1825048250 1.00
statpopgen_q06/duckdb:vortex-compact 2701504524 2656699194 1.02
statpopgen_q07/duckdb:vortex-compact 974211775 944812200 1.03
statpopgen_q08/duckdb:vortex-compact 1003003337 977426789 1.03
statpopgen_q09/duckdb:vortex-compact 3278927221 3323965162 0.99
statpopgen_q10/duckdb:vortex-compact 5375802841 5336965044 1.01
duckdb / parquet (0.992x ➖, 0↑ 0↓)
name PR 5881376 (ns) base 8efe1dc (ns) ratio (PR/base)
statpopgen_q00/duckdb:parquet 308306381 312512853 0.99
statpopgen_q01/duckdb:parquet 393977873 389784083 1.01
statpopgen_q02/duckdb:parquet 984142577 988659279 1.00
statpopgen_q03/duckdb:parquet 1481409429 1482799213 1.00
statpopgen_q04/duckdb:parquet 1480740575 1516264882 0.98
statpopgen_q05/duckdb:parquet 987452544 995274963 0.99
statpopgen_q06/duckdb:parquet 1475710156 1483071958 1.00
statpopgen_q07/duckdb:parquet 1854519206 1874289835 0.99
statpopgen_q08/duckdb:parquet 1880034240 1886555879 1.00
statpopgen_q09/duckdb:parquet 1341238511 1367897448 0.98
statpopgen_q10/duckdb:parquet 2661423402 2681679413 0.99
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 duckdb:vortex-compact -0.1% -1.3% +1.3% +10.0% ➖ noise
0 duckdb:vortex-file-compressed -1.1% -1.3% +0.3% +10.0% ➖ noise
1 duckdb:vortex-compact +2.9% +1.1% +1.8% +29.1% ➖ noise
1 duckdb:vortex-file-compressed -7.3% +1.1% -8.3% +251.0% ➖ noise
2 duckdb:vortex-compact +4.7% -0.5% +5.2% +10.0% ➖ noise
2 duckdb:vortex-file-compressed +0.9% -0.5% +1.4% +10.0% ➖ noise
3 duckdb:vortex-compact +6.8% -0.1% +6.9% +10.0% ➖ noise
3 duckdb:vortex-file-compressed -1.0% -0.1% -0.9% +10.0% ➖ noise
4 duckdb:vortex-compact +2.0% -2.3% +4.4% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -2.4% -2.3% -0.0% +10.0% ➖ noise
5 duckdb:vortex-compact +0.3% -0.8% +1.1% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +0.1% -0.8% +0.8% +10.0% ➖ noise
6 duckdb:vortex-compact +1.7% -0.5% +2.2% +10.0% ➖ noise
6 duckdb:vortex-file-compressed -0.0% -0.5% +0.5% +10.0% ➖ noise
7 duckdb:vortex-compact +3.1% -1.1% +4.2% +10.0% ➖ noise
7 duckdb:vortex-file-compressed +3.1% -1.1% +4.2% +10.0% ➖ noise
8 duckdb:vortex-compact +2.6% -0.3% +3.0% +10.0% ➖ noise
8 duckdb:vortex-file-compressed +5.6% -0.3% +6.0% +10.0% ➖ noise
9 duckdb:vortex-compact -1.4% -1.9% +0.6% +10.0% ➖ noise
9 duckdb:vortex-file-compressed +1.3% -1.9% +3.3% +10.0% ➖ noise
10 duckdb:vortex-compact +0.7% -0.8% +1.5% +10.0% ➖ noise
10 duckdb:vortex-file-compressed +2.0% -0.8% +2.8% +10.2% ➖ noise

@github-actions
Copy link
Contributor

github-actions bot commented Mar 18, 2026 •
edited
Loading

Benchmarks: Clickbench on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -2.0%
Vortex (geomean): 0.999x ➖
Parquet (geomean): 1.013x ➖
Shifts: Parquet (control) +1.3% · Median polish +0.3%

datafusion / vortex-file-compressed (1.020x ➖, 0↑ 3↓)
name PR 5881376 (ns) base 8efe1dc (ns) ratio (PR/base)
clickbench_q00/datafusion:vortex-file-compressed 1691977 1735579 0.97
clickbench_q01/datafusion:vortex-file-compressed 13835437 13926622 0.99
clickbench_q02/datafusion:vortex-file-compressed 33013661 31983645 1.03
clickbench_q03/datafusion:vortex-file-compressed 37256285 37046042 1.01
clickbench_q04/datafusion:vortex-file-compressed 333430565 321981520 1.04
clickbench_q05/datafusion:vortex-file-compressed 331558564 313708230 1.06
clickbench_q06/datafusion:vortex-file-compressed 1711406 1746164 0.98
clickbench_q07/datafusion:vortex-file-compressed 17514549 17376676 1.01
clickbench_q08/datafusion:vortex-file-compressed 388988574 394102077 0.99
clickbench_q09/datafusion:vortex-file-compressed 591828927 569415184 1.04
clickbench_q10/datafusion:vortex-file-compressed 71888079 73939748 0.97
clickbench_q11/datafusion:vortex-file-compressed 84114516 80824107 1.04
clickbench_q12/datafusion:vortex-file-compressed 280531617 279180799 1.00
clickbench_q13/datafusion:vortex-file-compressed 425326982 411437221 1.03
clickbench_q14/datafusion:vortex-file-compressed 258228358 254113922 1.02
clickbench_q15/datafusion:vortex-file-compressed 380019906 373375808 1.02
clickbench_q16/datafusion:vortex-file-compressed 742831819 726666243 1.02
clickbench_q17/datafusion:vortex-file-compressed 737119875 713834660 1.03
clickbench_q18/datafusion:vortex-file-compressed 1539017551 1464635784 1.05
clickbench_q19/datafusion:vortex-file-compressed 24731259 23812597 1.04
clickbench_q20/datafusion:vortex-file-compressed 🚨 381007803 338450718 1.13
clickbench_q21/datafusion:vortex-file-compressed 420738501 399160084 1.05
clickbench_q22/datafusion:vortex-file-compressed 🚨 590072914 523050889 1.13
clickbench_q23/datafusion:vortex-file-compressed 676480270 642165066 1.05
clickbench_q24/datafusion:vortex-file-compressed 46851992 49479095 0.95
clickbench_q25/datafusion:vortex-file-compressed 71679528 70861863 1.01
clickbench_q26/datafusion:vortex-file-compressed 🚨 52841571 47176424 1.12
clickbench_q27/datafusion:vortex-file-compressed 845423273 789841795 1.07
clickbench_q28/datafusion:vortex-file-compressed 6855364414 6699644697 1.02
clickbench_q29/datafusion:vortex-file-compressed 248137626 237428011 1.05
clickbench_q30/datafusion:vortex-file-compressed 238204760 256001436 0.93
clickbench_q31/datafusion:vortex-file-compressed 278925417 294849259 0.95
clickbench_q32/datafusion:vortex-file-compressed 1417488475 1297558834 1.09
clickbench_q33/datafusion:vortex-file-compressed 1442256620 1449625967 0.99
clickbench_q34/datafusion:vortex-file-compressed 1416654616 1456588037 0.97
clickbench_q35/datafusion:vortex-file-compressed 533407591 534552086 1.00
clickbench_q36/datafusion:vortex-file-compressed 78786744 80524119 0.98
clickbench_q37/datafusion:vortex-file-compressed 38091172 35948556 1.06
clickbench_q38/datafusion:vortex-file-compressed 23814664 23974992 0.99
clickbench_q39/datafusion:vortex-file-compressed 152373598 149589012 1.02
clickbench_q40/datafusion:vortex-file-compressed 20587674 20887161 0.99
clickbench_q41/datafusion:vortex-file-compressed 19024254 18975745 1.00
clickbench_q42/datafusion:vortex-file-compressed 22016159 21658640 1.02
datafusion / parquet (1.021x ➖, 0↑ 1↓)
name PR 5881376 (ns) base 8efe1dc (ns) ratio (PR/base)
clickbench_q00/datafusion:parquet 🚨 1789823 1551869 1.15
clickbench_q01/datafusion:parquet 21572307 21407819 1.01
clickbench_q02/datafusion:parquet 49717867 49332333 1.01
clickbench_q03/datafusion:parquet 42354840 41120330 1.03
clickbench_q04/datafusion:parquet 342249942 348819254 0.98
clickbench_q05/datafusion:parquet 385041455 368253845 1.05
clickbench_q06/datafusion:parquet 1667966 1590658 1.05
clickbench_q07/datafusion:parquet 26450169 25735479 1.03
clickbench_q08/datafusion:parquet 422068922 419539212 1.01
clickbench_q09/datafusion:parquet 652773820 650472976 1.00
clickbench_q10/datafusion:parquet 118421831 122715112 0.97
clickbench_q11/datafusion:parquet 144673698 145917838 0.99
clickbench_q12/datafusion:parquet 376842270 367694476 1.02
clickbench_q13/datafusion:parquet 522421600 520456725 1.00
clickbench_q14/datafusion:parquet 369573161 362863550 1.02
clickbench_q15/datafusion:parquet 403934232 387406852 1.04
clickbench_q16/datafusion:parquet 742394172 736588514 1.01
clickbench_q17/datafusion:parquet 732604473 722343034 1.01
clickbench_q18/datafusion:parquet 1499714295 1576145684 0.95
clickbench_q19/datafusion:parquet 34102323 32680991 1.04
clickbench_q20/datafusion:parquet 614716018 587198577 1.05
clickbench_q21/datafusion:parquet 681271740 681752327 1.00
clickbench_q22/datafusion:parquet 1012069685 993840212 1.02
clickbench_q23/datafusion:parquet 3810970876 3772510137 1.01
clickbench_q24/datafusion:parquet 94942166 100183969 0.95
clickbench_q25/datafusion:parquet 156160021 150358649 1.04
clickbench_q26/datafusion:parquet 95794704 97920427 0.98
clickbench_q27/datafusion:parquet 1063987013 1058480461 1.01
clickbench_q28/datafusion:parquet 6748750043 6577474407 1.03
clickbench_q29/datafusion:parquet 231759289 235614338 0.98
clickbench_q30/datafusion:parquet 380519300 376181625 1.01
clickbench_q31/datafusion:parquet 418523821 406388096 1.03
clickbench_q32/datafusion:parquet 1397681750 1274796585 1.10
clickbench_q33/datafusion:parquet 1583812540 1546942283 1.02
clickbench_q34/datafusion:parquet 1567412390 1529716789 1.02
clickbench_q35/datafusion:parquet 560899558 535451074 1.05
clickbench_q36/datafusion:parquet 144344347 137366109 1.05
clickbench_q37/datafusion:parquet 60626873 59036207 1.03
clickbench_q38/datafusion:parquet 93212355 92641024 1.01
clickbench_q39/datafusion:parquet 282938251 276098736 1.02
clickbench_q40/datafusion:parquet 37177543 34279813 1.08
clickbench_q41/datafusion:parquet 32009205 30869086 1.04
clickbench_q42/datafusion:parquet 32413128 31613528 1.03
duckdb / vortex-file-compressed (0.978x ➖, 5↑ 0↓)
name PR 5881376 (ns) base 8efe1dc (ns) ratio (PR/base)
clickbench_q00/duckdb:vortex-file-compressed 5983732 5932911 1.01
clickbench_q01/duckdb:vortex-file-compressed 13678096 13504964 1.01
clickbench_q02/duckdb:vortex-file-compressed 23580650 23692505 1.00
clickbench_q03/duckdb:vortex-file-compressed 29845294 30077718 0.99
clickbench_q04/duckdb:vortex-file-compressed 173852428 168454605 1.03
clickbench_q05/duckdb:vortex-file-compressed 200343016 193062771 1.04
clickbench_q06/duckdb:vortex-file-compressed 19410212 18788524 1.03
clickbench_q07/duckdb:vortex-file-compressed 16152219 15318520 1.05
clickbench_q08/duckdb:vortex-file-compressed 266914384 259922919 1.03
clickbench_q09/duckdb:vortex-file-compressed 377718619 370759396 1.02
clickbench_q10/duckdb:vortex-file-compressed 74563163 73324633 1.02
clickbench_q11/duckdb:vortex-file-compressed 83159077 80577193 1.03
clickbench_q12/duckdb:vortex-file-compressed 218057107 215081370 1.01
clickbench_q13/duckdb:vortex-file-compressed 440285382 426225006 1.03
clickbench_q14/duckdb:vortex-file-compressed 244962147 236784219 1.03
clickbench_q15/duckdb:vortex-file-compressed 214922390 208606884 1.03
clickbench_q16/duckdb:vortex-file-compressed 🚀 600332196 741191497 0.81
clickbench_q17/duckdb:vortex-file-compressed 🚀 533057202 639649280 0.83
clickbench_q18/duckdb:vortex-file-compressed 1243751742 1261286175 0.99
clickbench_q19/duckdb:vortex-file-compressed 21805489 21828368 1.00
clickbench_q20/duckdb:vortex-file-compressed 404093731 407358483 0.99
clickbench_q21/duckdb:vortex-file-compressed 435340720 404031025 1.08
clickbench_q22/duckdb:vortex-file-compressed 654799754 700855048 0.93
clickbench_q23/duckdb:vortex-file-compressed 🚀 1128567379 1932260288 0.58
clickbench_q24/duckdb:vortex-file-compressed 48149437 49879100 0.97
clickbench_q25/duckdb:vortex-file-compressed 76003316 76172716 1.00
clickbench_q26/duckdb:vortex-file-compressed 42958730 46310202 0.93
clickbench_q27/duckdb:vortex-file-compressed 540542981 543026979 1.00
clickbench_q28/duckdb:vortex-file-compressed 3024658184 3012646348 1.00
clickbench_q29/duckdb:vortex-file-compressed 28372179 27460183 1.03
clickbench_q30/duckdb:vortex-file-compressed 🚀 174508869 195155659 0.89
clickbench_q31/duckdb:vortex-file-compressed 260366417 271845117 0.96
clickbench_q32/duckdb:vortex-file-compressed 1364959207 1339660855 1.02
clickbench_q33/duckdb:vortex-file-compressed 1596770164 1744879268 0.92
clickbench_q34/duckdb:vortex-file-compressed 1767762082 1735345942 1.02
clickbench_q35/duckdb:vortex-file-compressed 378849557 369163673 1.03
clickbench_q36/duckdb:vortex-file-compressed 30561711 30349152 1.01
clickbench_q37/duckdb:vortex-file-compressed 21467470 21521834 1.00
clickbench_q38/duckdb:vortex-file-compressed 24296044 23852022 1.02
clickbench_q39/duckdb:vortex-file-compressed 45365983 45300740 1.00
clickbench_q40/duckdb:vortex-file-compressed 🚀 21217119 23788785 0.89
clickbench_q41/duckdb:vortex-file-compressed 20298444 21467862 0.95
clickbench_q42/duckdb:vortex-file-compressed 23657724 23229794 1.02
duckdb / parquet (1.006x ➖, 0↑ 0↓)
name PR 5881376 (ns) base 8efe1dc (ns) ratio (PR/base)
clickbench_q00/duckdb:parquet 228892552 217864812 1.05
clickbench_q01/duckdb:parquet 50321915 51108362 0.98
clickbench_q02/duckdb:parquet 66641432 66508278 1.00
clickbench_q03/duckdb:parquet 64719603 63654125 1.02
clickbench_q04/duckdb:parquet 208076242 203416379 1.02
clickbench_q05/duckdb:parquet 285282697 276318360 1.03
clickbench_q06/duckdb:parquet 60777847 60181506 1.01
clickbench_q07/duckdb:parquet 52751211 53545185 0.99
clickbench_q08/duckdb:parquet 271825776 266952568 1.02
clickbench_q09/duckdb:parquet 401683467 398255248 1.01
clickbench_q10/duckdb:parquet 97887921 94280498 1.04
clickbench_q11/duckdb:parquet 109080861 107603484 1.01
clickbench_q12/duckdb:parquet 295937613 300005946 0.99
clickbench_q13/duckdb:parquet 505903030 520957674 0.97
clickbench_q14/duckdb:parquet 334659020 325325624 1.03
clickbench_q15/duckdb:parquet 244485388 242557839 1.01
clickbench_q16/duckdb:parquet 610414627 620047186 0.98
clickbench_q17/duckdb:parquet 509353686 511603108 1.00
clickbench_q18/duckdb:parquet 1055893951 1049380186 1.01
clickbench_q19/duckdb:parquet 49487840 49556621 1.00
clickbench_q20/duckdb:parquet 433398192 435510800 1.00
clickbench_q21/duckdb:parquet 553865769 558029163 0.99
clickbench_q22/duckdb:parquet 923437701 940321780 0.98
clickbench_q23/duckdb:parquet 316335319 323781234 0.98
clickbench_q24/duckdb:parquet 79744543 77926883 1.02
clickbench_q25/duckdb:parquet 140708185 142151874 0.99
clickbench_q26/duckdb:parquet 53943035 52659435 1.02
clickbench_q27/duckdb:parquet 644452176 640135496 1.01
clickbench_q28/duckdb:parquet 4864907213 4830322101 1.01
clickbench_q29/duckdb:parquet 62065459 60918252 1.02
clickbench_q30/duckdb:parquet 310281223 305536991 1.02
clickbench_q31/duckdb:parquet 351223205 349730929 1.00
clickbench_q32/duckdb:parquet 1150221453 1140561170 1.01
clickbench_q33/duckdb:parquet 1244437997 1255810756 0.99
clickbench_q34/duckdb:parquet 1320467752 1274439748 1.04
clickbench_q35/duckdb:parquet 354417669 352256082 1.01
clickbench_q36/duckdb:parquet 63646083 62658998 1.02
clickbench_q37/duckdb:parquet 54055412 53894066 1.00
clickbench_q38/duckdb:parquet 57314472 57674969 0.99
clickbench_q39/duckdb:parquet 97688280 96722954 1.01
clickbench_q40/duckdb:parquet 55587571 56097778 0.99
clickbench_q41/duckdb:parquet 59063353 59169598 1.00
clickbench_q42/duckdb:parquet 50869555 50229958 1.01
duckdb / duckdb (0.980x ➖, 2↑ 0↓)
name PR 5881376 (ns) base 8efe1dc (ns) ratio (PR/base)
clickbench_q00/duckdb:duckdb 17757187 17835014 1.00
clickbench_q01/duckdb:duckdb 32600260 33222922 0.98
clickbench_q02/duckdb:duckdb 45506542 45069168 1.01
clickbench_q03/duckdb:duckdb 47432624 46896841 1.01
clickbench_q04/duckdb:duckdb 224419860 219638609 1.02
clickbench_q05/duckdb:duckdb 319043780 338302294 0.94
clickbench_q06/duckdb:duckdb 35361822 35253186 1.00
clickbench_q07/duckdb:duckdb 36022759 35242887 1.02
clickbench_q08/duckdb:duckdb 🚀 305929736 341683459 0.90
clickbench_q09/duckdb:duckdb 467853943 510258723 0.92
clickbench_q10/duckdb:duckdb 99150846 96853141 1.02
clickbench_q11/duckdb:duckdb 107999607 106072378 1.02
clickbench_q12/duckdb:duckdb 298053606 325529568 0.92
clickbench_q13/duckdb:duckdb 527872306 556269888 0.95
clickbench_q14/duckdb:duckdb 336489533 364658755 0.92
clickbench_q15/duckdb:duckdb 261677304 271090749 0.97
clickbench_q16/duckdb:duckdb 675089458 692683488 0.97
clickbench_q17/duckdb:duckdb 577502484 578484508 1.00
clickbench_q18/duckdb:duckdb 1269265106 1257487949 1.01
clickbench_q19/duckdb:duckdb 33939797 33829456 1.00
clickbench_q20/duckdb:duckdb 867727941 958010011 0.91
clickbench_q21/duckdb:duckdb 🚀 888565542 1107431625 0.80
clickbench_q22/duckdb:duckdb 1029365847 1139465362 0.90
clickbench_q23/duckdb:duckdb 257703002 244247284 1.06
clickbench_q24/duckdb:duckdb 61012556 61112167 1.00
clickbench_q25/duckdb:duckdb 123780453 124458603 0.99
clickbench_q26/duckdb:duckdb 51803176 53711042 0.96
clickbench_q27/duckdb:duckdb 972520296 1039339909 0.94
clickbench_q28/duckdb:duckdb 4669394665 4645432661 1.01
clickbench_q29/duckdb:duckdb 48322685 48061313 1.01
clickbench_q30/duckdb:duckdb 293091163 290462284 1.01
clickbench_q31/duckdb:duckdb 410855652 413553978 0.99
clickbench_q32/duckdb:duckdb 1481742408 1466788123 1.01
clickbench_q33/duckdb:duckdb 1980441653 1909006417 1.04
clickbench_q34/duckdb:duckdb 2015370032 2009509824 1.00
clickbench_q35/duckdb:duckdb 265321343 264129985 1.00
clickbench_q36/duckdb:duckdb 40695061 40823412 1.00
clickbench_q37/duckdb:duckdb 31083147 31321298 0.99
clickbench_q38/duckdb:duckdb 30714718 30303438 1.01
clickbench_q39/duckdb:duckdb 65926747 65565523 1.01
clickbench_q40/duckdb:duckdb 31388910 31178649 1.01
clickbench_q41/duckdb:duckdb 30348938 30266965 1.00
clickbench_q42/duckdb:duckdb 30944299 31409082 0.99
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-file-compressed -2.5% +10.1% -11.4% +662.9% ➖ noise
0 duckdb:duckdb -0.4% +10.1% -9.6% +305.2% ➖ noise
0 duckdb:vortex-file-compressed +0.9% +10.1% -8.4% +364.2% ➖ noise
1 datafusion:vortex-file-compressed -0.7% -0.4% -0.3% +38.8% ➖ noise
1 duckdb:duckdb -1.9% -0.4% -1.5% +60.3% ➖ noise
1 duckdb:vortex-file-compressed +1.3% -0.4% +1.7% +17.1% ➖ noise
2 datafusion:vortex-file-compressed +3.2% +0.5% +2.7% +37.8% ➖ noise
2 duckdb:duckdb +1.0% +0.5% +0.5% +24.5% ➖ noise
2 duckdb:vortex-file-compressed -0.5% +0.5% -1.0% +14.7% ➖ noise
3 datafusion:vortex-file-compressed +0.6% +2.3% -1.7% +172.4% ➖ noise
3 duckdb:duckdb +1.1% +2.3% -1.2% +56.9% ➖ noise
3 duckdb:vortex-file-compressed -0.8% +2.3% -3.0% +30.3% ➖ noise
4 datafusion:vortex-file-compressed +3.6% +0.2% +3.4% +10.0% ➖ noise
4 duckdb:duckdb +2.2% +0.2% +2.0% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +3.2% +0.2% +3.0% +10.0% ➖ noise
5 datafusion:vortex-file-compressed +5.7% +3.9% +1.7% +10.0% ➖ noise
5 duckdb:duckdb -5.7% +3.9% -9.2% +10.0% ✅ faster
5 duckdb:vortex-file-compressed +3.8% +3.9% -0.1% +10.0% ➖ noise
6 datafusion:vortex-file-compressed -2.0% +2.9% -4.8% +43.3% ➖ noise
6 duckdb:duckdb +0.3% +2.9% -2.5% +28.9% ➖ noise
6 duckdb:vortex-file-compressed +3.3% +2.9% +0.4% +18.9% ➖ noise
7 datafusion:vortex-file-compressed +0.8% +0.6% +0.2% +10.0% ➖ noise
7 duckdb:duckdb +2.2% +0.6% +1.6% +11.6% ➖ noise
7 duckdb:vortex-file-compressed +5.4% +0.6% +4.8% +10.0% ➖ noise
8 datafusion:vortex-file-compressed -1.3% +1.2% -2.5% +10.0% ➖ noise
8 duckdb:duckdb -10.5% +1.2% -11.5% +10.0% ✅ faster
8 duckdb:vortex-file-compressed +2.7% +1.2% +1.5% +10.0% ➖ noise
9 datafusion:vortex-file-compressed +3.9% +0.6% +3.3% +10.0% ➖ noise
9 duckdb:duckdb -8.3% +0.6% -8.9% +10.0% ➖ noise
9 duckdb:vortex-file-compressed +1.9% +0.6% +1.3% +10.0% ➖ noise
10 datafusion:vortex-file-compressed -2.8% +0.1% -2.9% +12.9% ➖ noise
10 duckdb:duckdb +2.4% +0.1% +2.3% +10.0% ➖ noise
10 duckdb:vortex-file-compressed +1.7% +0.1% +1.6% +10.0% ➖ noise
11 datafusion:vortex-file-compressed +4.1% +0.3% +3.8% +10.0% ➖ noise
11 duckdb:duckdb +1.8% +0.3% +1.6% +10.0% ➖ noise
11 duckdb:vortex-file-compressed +3.2% +0.3% +2.9% +10.0% ➖ noise
12 datafusion:vortex-file-compressed +0.5% +0.5% -0.1% +10.0% ➖ noise
12 duckdb:duckdb -8.4% +0.5% -8.9% +10.0% ➖ noise
12 duckdb:vortex-file-compressed +1.4% +0.5% +0.8% +10.0% ➖ noise
13 datafusion:vortex-file-compressed +3.4% -1.3% +4.7% +10.0% ➖ noise
13 duckdb:duckdb -5.1% -1.3% -3.9% +10.0% ➖ noise
13 duckdb:vortex-file-compressed +3.3% -1.3% +4.6% +10.0% ➖ noise
14 datafusion:vortex-file-compressed +1.6% +2.4% -0.7% +10.0% ➖ noise
14 duckdb:duckdb -7.7% +2.4% -9.9% +10.0% ✅ faster
14 duckdb:vortex-file-compressed +3.5% +2.4% +1.1% +10.0% ➖ noise
15 datafusion:vortex-file-compressed +1.8% +2.5% -0.7% +10.0% ➖ noise
15 duckdb:duckdb -3.5% +2.5% -5.8% +10.0% ➖ noise
15 duckdb:vortex-file-compressed +3.0% +2.5% +0.5% +10.0% ➖ noise
16 datafusion:vortex-file-compressed +2.2% -0.4% +2.6% +10.0% ➖ noise
16 duckdb:duckdb -2.5% -0.4% -2.2% +10.0% ➖ noise
16 duckdb:vortex-file-compressed -19.0% -0.4% -18.7% +14.9% ✅ faster
17 datafusion:vortex-file-compressed +3.3% +0.5% +2.8% +10.0% ➖ noise
17 duckdb:duckdb -0.2% +0.5% -0.7% +10.0% ➖ noise
17 duckdb:vortex-file-compressed -16.7% +0.5% -17.1% +13.9% ✅ faster
18 datafusion:vortex-file-compressed +5.1% -2.2% +7.4% +10.0% ➖ noise
18 duckdb:duckdb +0.9% -2.2% +3.2% +10.0% ➖ noise
18 duckdb:vortex-file-compressed -1.4% -2.2% +0.8% +10.8% ➖ noise
19 datafusion:vortex-file-compressed +3.9% +2.1% +1.7% +14.0% ➖ noise
19 duckdb:duckdb +0.3% +2.1% -1.7% +10.7% ➖ noise
19 duckdb:vortex-file-compressed -0.1% +2.1% -2.1% +26.3% ➖ noise
20 datafusion:vortex-file-compressed +12.6% +2.1% +10.3% +180.4% ➖ noise
20 duckdb:duckdb -9.4% +2.1% -11.3% +28.7% ➖ noise
20 duckdb:vortex-file-compressed -0.8% +2.1% -2.8% +10.0% ➖ noise
21 datafusion:vortex-file-compressed +5.4% -0.4% +5.8% +10.0% ➖ noise
21 duckdb:duckdb -19.8% -0.4% -19.4% +13.0% ✅ faster
21 duckdb:vortex-file-compressed +7.7% -0.4% +8.2% +10.0% ➖ noise
22 datafusion:vortex-file-compressed +12.8% +0.0% +12.8% +10.0% 🚨 regression
22 duckdb:duckdb -9.7% +0.0% -9.7% +10.0% ✅ faster
22 duckdb:vortex-file-compressed -6.6% +0.0% -6.6% +10.3% ➖ noise
23 datafusion:vortex-file-compressed +5.3% -0.7% +6.0% +52.2% ➖ noise
23 duckdb:duckdb +5.5% -0.7% +6.2% +10.0% ➖ noise
23 duckdb:vortex-file-compressed -41.6% -0.7% -41.2% +10.0% ✅ faster
24 datafusion:vortex-file-compressed -5.3% -1.5% -3.8% +16.4% ➖ noise
24 duckdb:duckdb -0.2% -1.5% +1.4% +10.0% ➖ noise
24 duckdb:vortex-file-compressed -3.5% -1.5% -2.0% +23.6% ➖ noise
25 datafusion:vortex-file-compressed +1.2% +1.4% -0.2% +10.8% ➖ noise
25 duckdb:duckdb -0.5% +1.4% -1.9% +10.0% ➖ noise
25 duckdb:vortex-file-compressed -0.2% +1.4% -1.6% +12.6% ➖ noise
26 datafusion:vortex-file-compressed +12.0% +0.1% +11.9% +11.5% 🚨 regression
26 duckdb:duckdb -3.6% +0.1% -3.7% +13.2% ➖ noise
26 duckdb:vortex-file-compressed -7.2% +0.1% -7.3% +23.5% ➖ noise
27 datafusion:vortex-file-compressed +7.0% +0.6% +6.4% +10.0% ➖ noise
27 duckdb:duckdb -6.4% +0.6% -7.0% +10.0% ➖ noise
27 duckdb:vortex-file-compressed -0.5% +0.6% -1.0% +10.0% ➖ noise
28 datafusion:vortex-file-compressed +2.3% +1.7% +0.7% +10.0% ➖ noise
28 duckdb:duckdb +0.5% +1.7% -1.1% +10.0% ➖ noise
28 duckdb:vortex-file-compressed +0.4% +1.7% -1.2% +10.0% ➖ noise
29 datafusion:vortex-file-compressed +4.5% +0.1% +4.4% +10.0% ➖ noise
29 duckdb:duckdb +0.5% +0.1% +0.4% +10.0% ➖ noise
29 duckdb:vortex-file-compressed +3.3% +0.1% +3.2% +11.9% ➖ noise
30 datafusion:vortex-file-compressed -7.0% +1.4% -8.2% +10.0% ➖ noise
30 duckdb:duckdb +0.9% +1.4% -0.4% +10.0% ➖ noise
30 duckdb:vortex-file-compressed -10.6% +1.4% -11.8% +10.0% ✅ faster
31 datafusion:vortex-file-compressed -5.4% +1.7% -7.0% +10.0% ➖ noise
31 duckdb:duckdb -0.7% +1.7% -2.3% +10.0% ➖ noise
31 duckdb:vortex-file-compressed -4.2% +1.7% -5.8% +10.0% ➖ noise
32 datafusion:vortex-file-compressed +9.2% +5.2% +3.9% +17.5% ➖ noise
32 duckdb:duckdb +1.0% +5.2% -3.9% +10.0% ➖ noise
32 duckdb:vortex-file-compressed +1.9% +5.2% -3.1% +10.0% ➖ noise
33 datafusion:vortex-file-compressed -0.5% +0.7% -1.2% +11.1% ➖ noise
33 duckdb:duckdb +3.7% +0.7% +3.0% +10.0% ➖ noise
33 duckdb:vortex-file-compressed -8.5% +0.7% -9.1% +10.0% ✅ faster
34 datafusion:vortex-file-compressed -2.7% +3.0% -5.6% +10.0% ➖ noise
34 duckdb:duckdb +0.3% +3.0% -2.7% +10.0% ➖ noise
34 duckdb:vortex-file-compressed +1.9% +3.0% -1.1% +10.0% ➖ noise
35 datafusion:vortex-file-compressed -0.2% +2.7% -2.8% +10.0% ➖ noise
35 duckdb:duckdb +0.5% +2.7% -2.2% +10.0% ➖ noise
35 duckdb:vortex-file-compressed +2.6% +2.7% -0.0% +10.0% ➖ noise
36 datafusion:vortex-file-compressed -2.2% +3.3% -5.3% +10.0% ➖ noise
36 duckdb:duckdb -0.3% +3.3% -3.5% +13.5% ➖ noise
36 duckdb:vortex-file-compressed +0.7% +3.3% -2.5% +10.0% ➖ noise
37 datafusion:vortex-file-compressed +6.0% +1.5% +4.4% +10.0% ➖ noise
37 duckdb:duckdb -0.8% +1.5% -2.2% +10.0% ➖ noise
37 duckdb:vortex-file-compressed -0.3% +1.5% -1.7% +10.9% ➖ noise
38 datafusion:vortex-file-compressed -0.7% -0.0% -0.7% +10.0% ➖ noise
38 duckdb:duckdb +1.4% -0.0% +1.4% +10.0% ➖ noise
38 duckdb:vortex-file-compressed +1.9% -0.0% +1.9% +11.3% ➖ noise
39 datafusion:vortex-file-compressed +1.9% +1.7% +0.1% +10.0% ➖ noise
39 duckdb:duckdb +0.6% +1.7% -1.2% +19.1% ➖ noise
39 duckdb:vortex-file-compressed +0.1% +1.7% -1.6% +10.0% ➖ noise
40 datafusion:vortex-file-compressed -1.4% +3.7% -4.9% +10.0% ➖ noise
40 duckdb:duckdb +0.7% +3.7% -2.9% +10.0% ➖ noise
40 duckdb:vortex-file-compressed -10.8% +3.7% -14.0% +10.0% ✅ faster
41 datafusion:vortex-file-compressed +0.3% +1.7% -1.5% +10.0% ➖ noise
41 duckdb:duckdb +0.3% +1.7% -1.4% +10.0% ➖ noise
41 duckdb:vortex-file-compressed -5.4% +1.7% -7.1% +10.0% ➖ noise
42 datafusion:vortex-file-compressed +1.7% +1.9% -0.2% +10.8% ➖ noise
42 duckdb:duckdb -1.5% +1.9% -3.3% +10.0% ➖ noise
42 duckdb:vortex-file-compressed +1.8% +1.9% -0.1% +14.9% ➖ noise

@github-actions
Copy link
Contributor

github-actions bot commented Mar 18, 2026 •
edited
Loading

Benchmarks: TPC-H SF=10 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +2.3%
Vortex (geomean): 0.985x ➖
Parquet (geomean): 0.963x ➖
Shifts: Parquet (control) -3.7% · Median polish +1.2%

datafusion / vortex-file-compressed (0.990x ➖, 1↑ 0↓)
name PR 5881376 (ns) base 8efe1dc (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 721277990 764285106 0.94
tpch_q02/datafusion:vortex-file-compressed 672633619 783424605 0.86
tpch_q03/datafusion:vortex-file-compressed 877585521 758194183 1.16
tpch_q04/datafusion:vortex-file-compressed 622630698 573126768 1.09
tpch_q05/datafusion:vortex-file-compressed 1109390121 1016718415 1.09
tpch_q06/datafusion:vortex-file-compressed 604696543 611177633 0.99
tpch_q07/datafusion:vortex-file-compressed 1142460078 1132699752 1.01
tpch_q08/datafusion:vortex-file-compressed 1341740467 1358743244 0.99
tpch_q09/datafusion:vortex-file-compressed 1570303884 1520818513 1.03
tpch_q10/datafusion:vortex-file-compressed 1160356311 1162272543 1.00
tpch_q11/datafusion:vortex-file-compressed 513427266 641802494 0.80
tpch_q12/datafusion:vortex-file-compressed 1032551388 1015472319 1.02
tpch_q13/datafusion:vortex-file-compressed 583487235 453388092 1.29
tpch_q14/datafusion:vortex-file-compressed 644381647 575988037 1.12
tpch_q15/datafusion:vortex-file-compressed 1131211938 1093174387 1.03
tpch_q16/datafusion:vortex-file-compressed 371361950 407191552 0.91
tpch_q17/datafusion:vortex-file-compressed 1296669409 1175325208 1.10
tpch_q18/datafusion:vortex-file-compressed 1344259060 1382688303 0.97
tpch_q19/datafusion:vortex-file-compressed 812110691 775287812 1.05
tpch_q20/datafusion:vortex-file-compressed 1069133839 1205118088 0.89
tpch_q21/datafusion:vortex-file-compressed 1641163295 1799316059 0.91
tpch_q22/datafusion:vortex-file-compressed 🚀 342347503 489494079 0.70
datafusion / vortex-compact (0.916x ➖, 1↑ 0↓)
name PR 5881376 (ns) base 8efe1dc (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 780893105 737092169 1.06
tpch_q02/datafusion:vortex-compact 814343707 778780690 1.05
tpch_q03/datafusion:vortex-compact 925361039 876167534 1.06
tpch_q04/datafusion:vortex-compact 605675098 641418999 0.94
tpch_q05/datafusion:vortex-compact 969541058 953115571 1.02
tpch_q06/datafusion:vortex-compact 760595713 909001498 0.84
tpch_q07/datafusion:vortex-compact 1218952716 1644143481 0.74
tpch_q08/datafusion:vortex-compact 1507254527 1816360176 0.83
tpch_q09/datafusion:vortex-compact 1526811232 1598659661 0.96
tpch_q10/datafusion:vortex-compact 1067552924 1272967499 0.84
tpch_q11/datafusion:vortex-compact 393449120 539401534 0.73
tpch_q12/datafusion:vortex-compact 851189498 906838912 0.94
tpch_q13/datafusion:vortex-compact 408361260 409459825 1.00
tpch_q14/datafusion:vortex-compact 589476099 699000437 0.84
tpch_q15/datafusion:vortex-compact 1064477361 1088977765 0.98
tpch_q16/datafusion:vortex-compact 302491033 380710937 0.79
tpch_q17/datafusion:vortex-compact 1174260362 1210264045 0.97
tpch_q18/datafusion:vortex-compact 1200500361 1218708961 0.99
tpch_q19/datafusion:vortex-compact 705632485 628653291 1.12
tpch_q20/datafusion:vortex-compact 882360597 893038023 0.99
tpch_q21/datafusion:vortex-compact 1438202916 1492523618 0.96
tpch_q22/datafusion:vortex-compact 🚀 379192599 559744420 0.68
datafusion / parquet (0.925x ➖, 0↑ 0↓)
name PR 5881376 (ns) base 8efe1dc (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 860746756 910306632 0.95
tpch_q02/datafusion:parquet 756740090 894634894 0.85
tpch_q03/datafusion:parquet 989043619 1035717297 0.95
tpch_q04/datafusion:parquet 474253710 497988008 0.95
tpch_q05/datafusion:parquet 1294247556 1416552120 0.91
tpch_q06/datafusion:parquet 557054516 568406970 0.98
tpch_q07/datafusion:parquet 1365956586 1594331258 0.86
tpch_q08/datafusion:parquet 1619883441 2196933888 0.74
tpch_q09/datafusion:parquet 1791071994 1884210925 0.95
tpch_q10/datafusion:parquet 2252802851 2277318885 0.99
tpch_q11/datafusion:parquet 678548795 773472204 0.88
tpch_q12/datafusion:parquet 774414395 780721202 0.99
tpch_q13/datafusion:parquet 755198770 790843061 0.95
tpch_q14/datafusion:parquet 874943487 929688204 0.94
tpch_q15/datafusion:parquet 1256508170 1419175572 0.89
tpch_q16/datafusion:parquet 560357735 572203811 0.98
tpch_q17/datafusion:parquet 1496618936 1592948277 0.94
tpch_q18/datafusion:parquet 1620077132 1828278685 0.89
tpch_q19/datafusion:parquet 1056058798 1012735392 1.04
tpch_q20/datafusion:parquet 1171760306 1378775890 0.85
tpch_q21/datafusion:parquet 1990768868 2001843835 0.99
tpch_q22/datafusion:parquet 774479553 838358956 0.92
duckdb / vortex-file-compressed (0.989x ➖, 0↑ 1↓)
name PR 5881376 (ns) base 8efe1dc (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 642223056 680958976 0.94
tpch_q02/duckdb:vortex-file-compressed 1026676309 1186799904 0.87
tpch_q03/duckdb:vortex-file-compressed 908209825 897951726 1.01
tpch_q04/duckdb:vortex-file-compressed 581576503 725297373 0.80
tpch_q05/duckdb:vortex-file-compressed 1211919689 1129571072 1.07
tpch_q06/duckdb:vortex-file-compressed 780757924 878232472 0.89
tpch_q07/duckdb:vortex-file-compressed 1213137399 1297459851 0.94
tpch_q08/duckdb:vortex-file-compressed 1597050586 1509014599 1.06
tpch_q09/duckdb:vortex-file-compressed 1409216414 1536225282 0.92
tpch_q10/duckdb:vortex-file-compressed 1092850108 1219078335 0.90
tpch_q11/duckdb:vortex-file-compressed 711802392 664315318 1.07
tpch_q12/duckdb:vortex-file-compressed 658274023 827452152 0.80
tpch_q13/duckdb:vortex-file-compressed 1058342770 963829787 1.10
tpch_q14/duckdb:vortex-file-compressed 840005694 854723250 0.98
tpch_q15/duckdb:vortex-file-compressed 535888432 582737474 0.92
tpch_q16/duckdb:vortex-file-compressed 🚨 570799605 416705084 1.37
tpch_q17/duckdb:vortex-file-compressed 1083200972 1025636391 1.06
tpch_q18/duckdb:vortex-file-compressed 1117141976 965001137 1.16
tpch_q19/duckdb:vortex-file-compressed 770589766 777729475 0.99
tpch_q20/duckdb:vortex-file-compressed 1310019569 1346389101 0.97
tpch_q21/duckdb:vortex-file-compressed 2099046139 2073926962 1.01
tpch_q22/duckdb:vortex-file-compressed 784543110 704382223 1.11
duckdb / vortex-compact (1.050x ➖, 0↑ 0↓)
name PR 5881376 (ns) base 8efe1dc (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 648295573 696992813 0.93
tpch_q02/duckdb:vortex-compact 1057843737 999242597 1.06
tpch_q03/duckdb:vortex-compact 896234841 987625258 0.91
tpch_q04/duckdb:vortex-compact 611839798 561280977 1.09
tpch_q05/duckdb:vortex-compact 1101012184 1114741611 0.99
tpch_q06/duckdb:vortex-compact 717918117 705781260 1.02
tpch_q07/duckdb:vortex-compact 1104383329 1148402136 0.96
tpch_q08/duckdb:vortex-compact 1439141281 1360453633 1.06
tpch_q09/duckdb:vortex-compact 1442985300 1379653390 1.05
tpch_q10/duckdb:vortex-compact 1390800413 1087932619 1.28
tpch_q11/duckdb:vortex-compact 977622574 788642777 1.24
tpch_q12/duckdb:vortex-compact 597766196 658518942 0.91
tpch_q13/duckdb:vortex-compact 901569192 930350050 0.97
tpch_q14/duckdb:vortex-compact 859008022 909934538 0.94
tpch_q15/duckdb:vortex-compact 586841346 545851553 1.08
tpch_q16/duckdb:vortex-compact 441756510 347983204 1.27
tpch_q17/duckdb:vortex-compact 975912029 933679533 1.05
tpch_q18/duckdb:vortex-compact 911938784 740560939 1.23
tpch_q19/duckdb:vortex-compact 844801087 759911814 1.11
tpch_q20/duckdb:vortex-compact 1431250557 1516127536 0.94
tpch_q21/duckdb:vortex-compact 1870225633 1812033180 1.03
tpch_q22/duckdb:vortex-compact 747185999 660161774 1.13
duckdb / parquet (1.004x ➖, 0↑ 1↓)
name PR 5881376 (ns) base 8efe1dc (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 903993762 926112497 0.98
tpch_q02/duckdb:parquet 1588139239 1406688530 1.13
tpch_q03/duckdb:parquet 1614105614 1888318201 0.85
tpch_q04/duckdb:parquet 1018606024 1308552460 0.78
tpch_q05/duckdb:parquet 2012081911 2246575076 0.90
tpch_q06/duckdb:parquet 758819808 844644732 0.90
tpch_q07/duckdb:parquet 1904257450 2152569105 0.88
tpch_q08/duckdb:parquet 2710211134 2661559224 1.02
tpch_q09/duckdb:parquet 2034863946 2310017326 0.88
tpch_q10/duckdb:parquet 2997976829 3085913042 0.97
tpch_q11/duckdb:parquet 1045590322 924964496 1.13
tpch_q12/duckdb:parquet 960203276 1078974314 0.89
tpch_q13/duckdb:parquet 🚨 1702050575 1150007669 1.48
tpch_q14/duckdb:parquet 1381880499 1415437929 0.98
tpch_q15/duckdb:parquet 1119622741 1049993136 1.07
tpch_q16/duckdb:parquet 925777231 786781833 1.18
tpch_q17/duckdb:parquet 1251312674 1307782766 0.96
tpch_q18/duckdb:parquet 1557514278 1475350530 1.06
tpch_q19/duckdb:parquet 1698813507 1627033138 1.04
tpch_q20/duckdb:parquet 1570312777 1646406990 0.95
tpch_q21/duckdb:parquet 2283037660 1799614266 1.27
tpch_q22/duckdb:parquet 1010970613 984555830 1.03
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact +5.9% -3.9% +10.3% +66.8% ➖ noise
1 datafusion:vortex-file-compressed -5.6% -3.9% -1.8% +87.4% ➖ noise
1 duckdb:vortex-compact -7.0% -3.9% -3.2% +44.2% ➖ noise
1 duckdb:vortex-file-compressed -5.7% -3.9% -1.8% +34.7% ➖ noise
2 datafusion:vortex-compact +4.6% -2.3% +7.0% +47.8% ➖ noise
2 datafusion:vortex-file-compressed -14.1% -2.3% -12.1% +68.2% ➖ noise
2 duckdb:vortex-compact +5.9% -2.3% +8.3% +41.7% ➖ noise
2 duckdb:vortex-file-compressed -13.5% -2.3% -11.5% +44.0% ➖ noise
3 datafusion:vortex-compact +5.6% -9.7% +16.9% +69.7% ➖ noise
3 datafusion:vortex-file-compressed +15.7% -9.7% +28.1% +83.5% ➖ noise
3 duckdb:vortex-compact -9.3% -9.7% +0.4% +68.8% ➖ noise
3 duckdb:vortex-file-compressed +1.1% -9.7% +11.9% +56.3% ➖ noise
4 datafusion:vortex-compact -5.6% -13.9% +9.7% +46.4% ➖ noise
4 datafusion:vortex-file-compressed +8.6% -13.9% +26.2% +30.0% ➖ noise
4 duckdb:vortex-compact +9.0% -13.9% +26.6% +39.3% ➖ noise
4 duckdb:vortex-file-compressed -19.8% -13.9% -6.9% +30.0% ➖ noise
5 datafusion:vortex-compact +1.7% -9.5% +12.5% +30.0% ➖ noise
5 datafusion:vortex-file-compressed +9.1% -9.5% +20.6% +30.0% ➖ noise
5 duckdb:vortex-compact -1.2% -9.5% +9.2% +30.0% ➖ noise
5 duckdb:vortex-file-compressed +7.3% -9.5% +18.6% +30.0% ➖ noise
6 datafusion:vortex-compact -16.3% -6.2% -10.8% +83.6% ➖ noise
6 datafusion:vortex-file-compressed -1.1% -6.2% +5.4% +30.0% ➖ noise
6 duckdb:vortex-compact +1.7% -6.2% +8.4% +30.0% ➖ noise
6 duckdb:vortex-file-compressed -11.1% -6.2% -5.3% +30.0% ➖ noise
7 datafusion:vortex-compact -25.9% -12.9% -14.8% +30.0% ➖ noise
7 datafusion:vortex-file-compressed +0.9% -12.9% +15.9% +30.0% ➖ noise
7 duckdb:vortex-compact -3.8% -12.9% +10.5% +30.0% ➖ noise
7 duckdb:vortex-file-compressed -6.5% -12.9% +7.4% +30.8% ➖ noise
8 datafusion:vortex-compact -17.0% -13.4% -4.2% +60.0% ➖ noise
8 datafusion:vortex-file-compressed -1.3% -13.4% +14.0% +30.0% ➖ noise
8 duckdb:vortex-compact +5.8% -13.4% +22.1% +30.0% ➖ noise
8 duckdb:vortex-file-compressed +5.8% -13.4% +22.1% +30.0% ➖ noise
9 datafusion:vortex-compact -4.5% -8.5% +4.4% +33.8% ➖ noise
9 datafusion:vortex-file-compressed +3.3% -8.5% +12.8% +30.0% ➖ noise
9 duckdb:vortex-compact +4.6% -8.5% +14.3% +30.0% ➖ noise
9 duckdb:vortex-file-compressed -8.3% -8.5% +0.2% +30.0% ➖ noise
10 datafusion:vortex-compact -16.1% -2.0% -14.5% +40.9% ➖ noise
10 datafusion:vortex-file-compressed -0.2% -2.0% +1.8% +33.9% ➖ noise
10 duckdb:vortex-compact +27.8% -2.0% +30.4% +37.7% ➖ noise
10 duckdb:vortex-file-compressed -10.4% -2.0% -8.6% +39.7% ➖ noise
11 datafusion:vortex-compact -27.1% -0.4% -26.8% +57.0% ➖ noise
11 datafusion:vortex-file-compressed -20.0% -0.4% -19.7% +35.1% ➖ noise
11 duckdb:vortex-compact +24.0% -0.4% +24.5% +30.0% ➖ noise
11 duckdb:vortex-file-compressed +7.1% -0.4% +7.6% +30.0% ➖ noise
12 datafusion:vortex-compact -6.1% -6.0% -0.1% +34.1% ➖ noise
12 datafusion:vortex-file-compressed +1.7% -6.0% +8.2% +30.0% ➖ noise
12 duckdb:vortex-compact -9.2% -6.0% -3.4% +45.3% ➖ noise
12 duckdb:vortex-file-compressed -20.4% -6.0% -15.3% +39.7% ➖ noise
13 datafusion:vortex-compact -0.3% +18.9% -16.1% +56.9% ➖ noise
13 datafusion:vortex-file-compressed +28.7% +18.9% +8.3% +41.3% ➖ noise
13 duckdb:vortex-compact -3.1% +18.9% -18.5% +81.1% ➖ noise
13 duckdb:vortex-file-compressed +9.8% +18.9% -7.6% +74.5% ➖ noise
14 datafusion:vortex-compact -15.7% -4.1% -12.0% +31.9% ➖ noise
14 datafusion:vortex-file-compressed +11.9% -4.1% +16.7% +30.0% ➖ noise
14 duckdb:vortex-compact -5.6% -4.1% -1.5% +30.0% ➖ noise
14 duckdb:vortex-file-compressed -1.7% -4.1% +2.5% +30.0% ➖ noise
15 datafusion:vortex-compact -2.2% -2.8% +0.6% +30.0% ➖ noise
15 datafusion:vortex-file-compressed +3.5% -2.8% +6.5% +30.0% ➖ noise
15 duckdb:vortex-compact +7.5% -2.8% +10.6% +30.0% ➖ noise
15 duckdb:vortex-file-compressed -8.0% -2.8% -5.4% +30.0% ➖ noise
16 datafusion:vortex-compact -20.5% +7.3% -26.0% +45.9% ➖ noise
16 datafusion:vortex-file-compressed -8.8% +7.3% -15.0% +46.6% ➖ noise
16 duckdb:vortex-compact +26.9% +7.3% +18.3% +34.7% ➖ noise
16 duckdb:vortex-file-compressed +37.0% +7.3% +27.6% +58.8% ➖ noise
17 datafusion:vortex-compact -3.0% -5.2% +2.3% +30.0% ➖ noise
17 datafusion:vortex-file-compressed +10.3% -5.2% +16.4% +30.0% ➖ noise
17 duckdb:vortex-compact +4.5% -5.2% +10.2% +30.0% ➖ noise
17 duckdb:vortex-file-compressed +5.6% -5.2% +11.4% +30.0% ➖ noise
18 datafusion:vortex-compact -1.5% -3.3% +1.8% +30.0% ➖ noise
18 datafusion:vortex-file-compressed -2.8% -3.3% +0.5% +30.0% ➖ noise
18 duckdb:vortex-compact +23.1% -3.3% +27.3% +31.0% ➖ noise
18 duckdb:vortex-file-compressed +15.8% -3.3% +19.7% +33.9% ➖ noise
19 datafusion:vortex-compact +12.2% +4.3% +7.6% +31.7% ➖ noise
19 datafusion:vortex-file-compressed +4.7% +4.3% +0.4% +30.0% ➖ noise
19 duckdb:vortex-compact +11.2% +4.3% +6.5% +30.0% ➖ noise
19 duckdb:vortex-file-compressed -0.9% +4.3% -5.0% +30.0% ➖ noise
20 datafusion:vortex-compact -1.2% -10.0% +9.7% +30.0% ➖ noise
20 datafusion:vortex-file-compressed -11.3% -10.0% -1.5% +30.0% ➖ noise
20 duckdb:vortex-compact -5.6% -10.0% +4.9% +30.0% ➖ noise
20 duckdb:vortex-file-compressed -2.7% -10.0% +8.1% +30.0% ➖ noise
21 datafusion:vortex-compact -3.6% +12.3% -14.2% +30.0% ➖ noise
21 datafusion:vortex-file-compressed -8.8% +12.3% -18.8% +30.0% ➖ noise
21 duckdb:vortex-compact +3.2% +12.3% -8.1% +30.0% ➖ noise
21 duckdb:vortex-file-compressed +1.2% +12.3% -9.9% +30.0% ➖ noise
22 datafusion:vortex-compact -32.3% -2.6% -30.4% +36.4% ✅ faster
22 datafusion:vortex-file-compressed -30.1% -2.6% -28.2% +30.0% ✅ faster
22 duckdb:vortex-compact +13.2% -2.6% +16.2% +30.0% ➖ noise
22 duckdb:vortex-file-compressed +11.4% -2.6% +14.4% +30.0% ➖ noise

@github-actions
Copy link
Contributor

github-actions bot commented Mar 18, 2026 •
edited
Loading

Benchmarks: Random Access

Vortex (geomean): 0.963x ➖
Parquet (geomean): 1.057x ➖

unknown / unknown (1.044x ➖, 6↑ 17↓)
name PR 5881376 (ns) base 8efe1dc (ns) ratio (PR/base)
random-access/feature-vectors/correlated/lance-tokio-local-disk 🚨 2832416 2290957 1.24
random-access/feature-vectors/correlated/lance-tokio-local-disk-footer 🚨 1414411 1265947 1.12
random-access/feature-vectors/correlated/parquet-tokio-local-disk 14125603824 13926391014 1.01
random-access/feature-vectors/correlated/parquet-tokio-local-disk-footer 13574973849 13418168156 1.01
random-access/feature-vectors/correlated/vortex-tokio-local-disk 7891598 7767430 1.02
random-access/feature-vectors/correlated/vortex-tokio-local-disk-footer 6344441 6490267 0.98
random-access/feature-vectors/uniform/lance-tokio-local-disk 🚨 1706739 1456752 1.17
random-access/feature-vectors/uniform/lance-tokio-local-disk-footer 🚨 2696557 2355981 1.14
random-access/feature-vectors/uniform/parquet-tokio-local-disk 13558433124 13380216051 1.01
random-access/feature-vectors/uniform/parquet-tokio-local-disk-footer 13741345065 13505502279 1.02
random-access/feature-vectors/uniform/vortex-tokio-local-disk 13252317 13884939 0.95
random-access/feature-vectors/uniform/vortex-tokio-local-disk-footer 13170285 13911643 0.95
random-access/lance-tokio-local-disk 793195 738018 1.07
random-access/lance-tokio-local-disk-footer 🚨 1490889 1338915 1.11
random-access/nested-lists/correlated/lance-tokio-local-disk 290766 267458 1.09
random-access/nested-lists/correlated/lance-tokio-local-disk-footer 🚨 831794 716915 1.16
random-access/nested-lists/correlated/parquet-tokio-local-disk 168268875 159831348 1.05
random-access/nested-lists/correlated/parquet-tokio-local-disk-footer 167322056 158399478 1.06
random-access/nested-lists/correlated/vortex-tokio-local-disk 754062 695147 1.08
random-access/nested-lists/correlated/vortex-tokio-local-disk-footer 🚨 843885 708641 1.19
random-access/nested-lists/uniform/lance-tokio-local-disk 🚨 1294744 1172607 1.10
random-access/nested-lists/uniform/lance-tokio-local-disk-footer 🚨 1856172 1662491 1.12
random-access/nested-lists/uniform/parquet-tokio-local-disk 168908629 159154654 1.06
random-access/nested-lists/uniform/parquet-tokio-local-disk-footer 168639425 161219123 1.05
random-access/nested-lists/uniform/vortex-tokio-local-disk 2565693 2479656 1.03
random-access/nested-lists/uniform/vortex-tokio-local-disk-footer 2630009 2680851 0.98
random-access/nested-structs/correlated/lance-tokio-local-disk 469094 433529 1.08
random-access/nested-structs/correlated/lance-tokio-local-disk-footer 🚨 719272 634431 1.13
random-access/nested-structs/correlated/parquet-tokio-local-disk 🚨 29215698 26066257 1.12
random-access/nested-structs/correlated/parquet-tokio-local-disk-footer 29459965 27110693 1.09
random-access/nested-structs/correlated/vortex-tokio-local-disk 🚨 964278 869438 1.11
random-access/nested-structs/correlated/vortex-tokio-local-disk-footer 973474 904410 1.08
random-access/nested-structs/uniform/lance-tokio-local-disk 🚨 3151614 2847684 1.11
random-access/nested-structs/uniform/lance-tokio-local-disk-footer 🚨 3447084 3104025 1.11
random-access/nested-structs/uniform/parquet-tokio-local-disk 🚨 29338591 26579146 1.10
random-access/nested-structs/uniform/parquet-tokio-local-disk-footer 🚨 29285137 25931652 1.13
random-access/nested-structs/uniform/vortex-tokio-local-disk 🚨 1939737 1726699 1.12
random-access/nested-structs/uniform/vortex-tokio-local-disk-footer 1921546 1750704 1.10
random-access/parquet-tokio-local-disk 195012516 185655697 1.05
random-access/parquet-tokio-local-disk-footer 193687988 186995940 1.04
random-access/taxi/correlated/lance-tokio-local-disk 1028204 958396 1.07
random-access/taxi/correlated/lance-tokio-local-disk-footer 1799909 1640197 1.10
random-access/taxi/correlated/parquet-tokio-local-disk 292969515 271952459 1.08
random-access/taxi/correlated/parquet-tokio-local-disk-footer 292424056 275795227 1.06
random-access/taxi/correlated/vortex-tokio-local-disk 🚀 1856089 2564086 0.72
random-access/taxi/correlated/vortex-tokio-local-disk-footer 🚀 1868066 2240046 0.83
random-access/taxi/uniform/lance-tokio-local-disk 9301985 8484366 1.10
random-access/taxi/uniform/lance-tokio-local-disk-footer 10058108 9156630 1.10
random-access/taxi/uniform/parquet-tokio-local-disk 304109651 289211191 1.05
random-access/taxi/uniform/parquet-tokio-local-disk-footer 304789033 291876232 1.04
random-access/taxi/uniform/vortex-tokio-local-disk 🚀 4579615 5268355 0.87
random-access/taxi/uniform/vortex-tokio-local-disk-footer 🚀 4641795 5185606 0.90
random-access/vortex-tokio-local-disk 🚀 1279362 1721374 0.74
random-access/vortex-tokio-local-disk-footer 🚀 1297452 1550049 0.84

@github-actions
Copy link
Contributor

github-actions bot commented Mar 18, 2026 •
edited
Loading

Benchmarks: Compression

Vortex (geomean): 1.010x ➖
Parquet (geomean): 1.008x ➖

unknown / unknown (1.011x ➖, 2↑ 3↓)
name PR 5881376 (ns) base 8efe1dc (ns) ratio (PR/base)
compress time/Arade 1121544564 1111833187 1.01
compress time/Bimbo 6981485057 7195006811 0.97
compress time/CMSprovider 2904935572 2930090626 0.99
compress time/Euro2016 420348397 416165768 1.01
compress time/Food 367961573 389326561 0.95
compress time/HashTags 915662421 947243543 0.97
compress time/TPC-H l_comment canonical 1309077822 1269498736 1.03
compress time/TPC-H l_comment chunked 1294395232 1311460225 0.99
compress time/taxi 730078219 724112888 1.01
compress time/wide table cols=100 chunks=1 rows=1000 15743411 15066932 1.04
compress time/wide table cols=100 chunks=50 rows=1000 17083205 16004026 1.07
compress time/wide table cols=1000 chunks=1 rows=1000 160528335 154708228 1.04
compress time/wide table cols=1000 chunks=50 rows=1000 157358348 154250585 1.02
compress time/wide table cols=10000 chunks=1 rows=1000 1546258574 1539949243 1.00
compress time/wide table cols=10000 chunks=50 rows=1000 1607256589 1522414835 1.06
decompress time/Arade 30942089 31313918 0.99
decompress time/Bimbo 101107854 98497604 1.03
decompress time/CMSprovider 83982810 82836097 1.01
decompress time/Euro2016 23345221 21494626 1.09
decompress time/Food 🚀 7775038 9097660 0.85
decompress time/HashTags 78739923 77770934 1.01
decompress time/TPC-H l_comment canonical 43368944 40931538 1.06
decompress time/TPC-H l_comment chunked 42042882 41871949 1.00
decompress time/taxi 19323998 19258212 1.00
decompress time/wide table cols=100 chunks=1 rows=1000 2687897 2559469 1.05
decompress time/wide table cols=100 chunks=50 rows=1000 2717541 2505651 1.08
decompress time/wide table cols=1000 chunks=1 rows=1000 23781546 22546434 1.05
decompress time/wide table cols=1000 chunks=50 rows=1000 24142286 22315036 1.08
decompress time/wide table cols=10000 chunks=1 rows=1000 248291484 228791295 1.09
decompress time/wide table cols=10000 chunks=50 rows=1000 🚨 264302205 228496944 1.16
parquet size/Arade 305282152 305282152 1.00
parquet size/Bimbo 388935055 388935055 1.00
parquet size/CMSprovider 384634824 384634824 1.00
parquet size/Euro2016 123042700 123042700 1.00
parquet size/Food 36177631 36177631 1.00
parquet size/HashTags 133854962 133854962 1.00
parquet size/TPC-H l_comment canonical 158411391 158411391 1.00
parquet size/TPC-H l_comment chunked 158411391 158411391 1.00
parquet size/taxi 55879185 55879185 1.00
parquet size/wide table cols=100 chunks=1 rows=1000 932204 932204 1.00
parquet size/wide table cols=100 chunks=50 rows=1000 932204 932204 1.00
parquet size/wide table cols=1000 chunks=1 rows=1000 9322004 9322004 1.00
parquet size/wide table cols=1000 chunks=50 rows=1000 9322004 9322004 1.00
parquet size/wide table cols=10000 chunks=1 rows=1000 93220004 93220004 1.00
parquet size/wide table cols=10000 chunks=50 rows=1000 93220004 93220004 1.00
parquet_rs-zstd compress time/Arade 2497548892 2491364798 1.00
parquet_rs-zstd compress time/Bimbo 15827250434 15644508888 1.01
parquet_rs-zstd compress time/CMSprovider 7937187272 7772350774 1.02
parquet_rs-zstd compress time/Euro2016 1476695226 1446593133 1.02
parquet_rs-zstd compress time/Food 935112159 926550003 1.01
parquet_rs-zstd compress time/HashTags 2533765334 2508098294 1.01
parquet_rs-zstd compress time/TPC-H l_comment canonical 3228114777 3193990109 1.01
parquet_rs-zstd compress time/TPC-H l_comment chunked 3190558309 3179874483 1.00
parquet_rs-zstd compress time/taxi 1393390499 1378719525 1.01
parquet_rs-zstd compress time/wide table cols=100 chunks=1 rows=1000 6630301 6491906 1.02
parquet_rs-zstd compress time/wide table cols=100 chunks=50 rows=1000 6797986 6564381 1.04
parquet_rs-zstd compress time/wide table cols=1000 chunks=1 rows=1000 82634254 90282177 0.92
parquet_rs-zstd compress time/wide table cols=1000 chunks=50 rows=1000 83240596 88176268 0.94
parquet_rs-zstd compress time/wide table cols=10000 chunks=1 rows=1000 894763155 892389508 1.00
parquet_rs-zstd compress time/wide table cols=10000 chunks=50 rows=1000 881451290 902971839 0.98
parquet_rs-zstd decompress time/Arade 664149510 664199700 1.00
parquet_rs-zstd decompress time/Bimbo 2314941704 2253140392 1.03
parquet_rs-zstd decompress time/CMSprovider 2119304061 2114038591 1.00
parquet_rs-zstd decompress time/Euro2016 423048424 418618096 1.01
parquet_rs-zstd decompress time/Food 241456940 238804982 1.01
parquet_rs-zstd decompress time/HashTags 676937723 675354355 1.00
parquet_rs-zstd decompress time/TPC-H l_comment canonical 721510464 705555088 1.02
parquet_rs-zstd decompress time/TPC-H l_comment chunked 713955414 710155422 1.01
parquet_rs-zstd decompress time/taxi 290142638 290032926 1.00
parquet_rs-zstd decompress time/wide table cols=100 chunks=1 rows=1000 2593746 2535505 1.02
parquet_rs-zstd decompress time/wide table cols=100 chunks=50 rows=1000 2652416 2541463 1.04
parquet_rs-zstd decompress time/wide table cols=1000 chunks=1 rows=1000 29240149 29434394 0.99
parquet_rs-zstd decompress time/wide table cols=1000 chunks=50 rows=1000 29702406 29652059 1.00
parquet_rs-zstd decompress time/wide table cols=10000 chunks=1 rows=1000 340656471 342396771 0.99
parquet_rs-zstd decompress time/wide table cols=10000 chunks=50 rows=1000 344304722 337934660 1.02
vortex-file-compressed size/Arade 143320892 143320276 1.00
vortex-file-compressed size/Bimbo 526057964 526057964 1.00
vortex-file-compressed size/CMSprovider 448338524 448071556 1.00
vortex-file-compressed size/Euro2016 167863828 164656676 1.02
vortex-file-compressed size/Food 44162400 44159616 1.00
vortex-file-compressed size/HashTags 198700644 195365036 1.02
vortex-file-compressed size/TPC-H l_comment canonical 180408824 179476200 1.01
vortex-file-compressed size/TPC-H l_comment chunked 180408824 179476200 1.01
vortex-file-compressed size/taxi 51448740 51449348 1.00
vortex-file-compressed size/wide table cols=100 chunks=1 rows=1000 884384 884384 1.00
vortex-file-compressed size/wide table cols=100 chunks=50 rows=1000 884384 884384 1.00
vortex-file-compressed size/wide table cols=1000 chunks=1 rows=1000 8829584 8829584 1.00
vortex-file-compressed size/wide table cols=1000 chunks=50 rows=1000 8829584 8829584 1.00
vortex-file-compressed size/wide table cols=10000 chunks=1 rows=1000 88317584 88317584 1.00
vortex-file-compressed size/wide table cols=10000 chunks=50 rows=1000 88317584 88317584 1.00
vortex:parquet-zstd ratio compress time/Arade 0 0 1.01
vortex:parquet-zstd ratio compress time/Bimbo 0 0 0.96
vortex:parquet-zstd ratio compress time/CMSprovider 0 0 0.97
vortex:parquet-zstd ratio compress time/Euro2016 0 0 0.99
vortex:parquet-zstd ratio compress time/Food 0 0 0.94
vortex:parquet-zstd ratio compress time/HashTags 0 0 0.96
vortex:parquet-zstd ratio compress time/TPC-H l_comment canonical 0 0 1.02
vortex:parquet-zstd ratio compress time/TPC-H l_comment chunked 0 0 0.98
vortex:parquet-zstd ratio compress time/taxi 0 0 1.00
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=1 rows=1000 2 2 1.02
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=50 rows=1000 2 2 1.03
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=1 rows=1000 🚨 1 1 1.13
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=50 rows=1000 1 1 1.08
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=1 rows=1000 1 1 1.00
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=50 rows=1000 1 1 1.08
vortex:parquet-zstd ratio decompress time/Arade 0 0 0.99
vortex:parquet-zstd ratio decompress time/Bimbo 0 0 1.00
vortex:parquet-zstd ratio decompress time/CMSprovider 0 0 1.01
vortex:parquet-zstd ratio decompress time/Euro2016 0 0 1.07
vortex:parquet-zstd ratio decompress time/Food 🚀 0 0 0.85
vortex:parquet-zstd ratio decompress time/HashTags 0 0 1.01
vortex:parquet-zstd ratio decompress time/TPC-H l_comment canonical 0 0 1.04
vortex:parquet-zstd ratio decompress time/TPC-H l_comment chunked 0 0 1.00
vortex:parquet-zstd ratio decompress time/taxi 0 0 1.00
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=1 rows=1000 1 1 1.03
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=50 rows=1000 1 0 1.04
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=1 rows=1000 0 0 1.06
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=50 rows=1000 0 0 1.08
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=1 rows=1000 0 0 1.09
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=50 rows=1000 🚨 0 0 1.14
vortex:parquet-zstd size/Arade 0 0 1.00
vortex:parquet-zstd size/Bimbo 1 1 1.00
vortex:parquet-zstd size/CMSprovider 1 1 1.00
vortex:parquet-zstd size/Euro2016 1 1 1.02
vortex:parquet-zstd size/Food 1 1 1.00
vortex:parquet-zstd size/HashTags 1 1 1.02
vortex:parquet-zstd size/TPC-H l_comment canonical 1 1 1.01
vortex:parquet-zstd size/TPC-H l_comment chunked 1 1 1.01
vortex:parquet-zstd size/taxi 0 0 1.00
vortex:parquet-zstd size/wide table cols=100 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=100 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=50 rows=1000 0 0 1.00

@joseph-isaacs
fixup
9d278dc 
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@joseph-isaacs joseph-isaacs requested a review from 0ax1 March 19, 2026 14:09
@joseph-isaacs joseph-isaacs marked this pull request as ready for review March 19, 2026 14:09
@joseph-isaacs joseph-isaacs added the action/benchmark Trigger full benchmarks to run on this PR label Mar 19, 2026
@github-actions github-actions bot removed the action/benchmark Trigger full benchmarks to run on this PR label Mar 19, 2026
@joseph-isaacs
fixup
6c8e616 
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@joseph-isaacs
fixup
2113488 
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@joseph-isaacs
fixup
173cbda 
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@joseph-isaacs joseph-isaacs added the action/benchmark Trigger full benchmarks to run on this PR label Mar 19, 2026
@joseph-isaacs
fixup
5881376 
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@joseph-isaacs joseph-isaacs added action/benchmark Trigger full benchmarks to run on this PR and removed action/benchmark Trigger full benchmarks to run on this PR labels Mar 19, 2026
@github-actions github-actions bot removed the action/benchmark Trigger full benchmarks to run on this PR label Mar 19, 2026
@joseph-isaacs
fixup
ef16508 
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
0ax1
0ax1 reviewed Mar 19, 2026
View reviewed changes
Copy link
Contributor

@0ax1 0ax1 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Initial first pass. Doing a second in depth round.

0ax1
0ax1 reviewed Mar 19, 2026
View reviewed changes
@joseph-isaacs
fixup
ef2445b 
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@joseph-isaacs
fixup
b013dad 
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@0ax1 0ax1 0ax1 left review comments

At least 1 approving review is required to merge this pull request.

Assignees

No one assigned

Labels

changelog/performance A performance improvement

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@joseph-isaacs @0ax1